Google Lens is rolling out a new feature that lets users ask questions about moving objects while recording videos. Users can now capture a video through the Google app and inquire about the things they’re seeing in real time. The app will then provide AI-generated responses along with additional online resources based on the video and voice prompt. 

According to Lou Wang, Director of Product Management for Google Lens, the feature uses a "customized" Gemini model to interpret the video and relevant inquiries. He explained that this AI model analyzes the video and identifies relevant moments or frames that relate to the user's question.

Who can access this feature?

This update is available globally for both Android and iOS users and currently supports queries in English.

How can users access the feature?

To use the video feature, users need to sign up for Google’s Search Labs program and opt into the “AI Overviews and More” experiment. Once users are set up, they can hold their phone shutter button to activate the video-capturing mode in the Google app.

In addition to video searches, Google has also added support for asking voice-based questions when taking still images with Lens. You can point the camera, hold the shutter button, and ask a question to get more information about what's in the frame.