Google is rolling out two major updates to Lens.  With the new features, iPhone users can now search what’s on their screen with Lens, while AI-powered Overviews will appear more often in search results. The goal, according to Google, is for users to perform visual searches across more apps and devices.

Google Lens adds ‘Search Screen’ for iPhone users

iPhone users can now search their screens directly within Chrome and the Google app. According to the company, this update lets users “quickly perform a visual search while browsing.” iOS users can search specific content from their screen using simple gestures such as tapping, highlighting, or drawing a circle.

This update eliminates the need for screenshots or opening new tabs while browsing. 

To access the feature in Chrome, users can tap the three-dot menu and select “Search Screen with Google Lens.” It also works the same way on the Google app. Users can tap the three-dot menu, choose “Search this Screen,” and select what they want to search.

Google says this feature is rolling out globally this week for Chrome and the Google app on iOS. In the coming months, the company plans to add a Lens icon in the address bar, similar to the Lens experience launched for Chrome desktop last year.

AI Overviews expansion in Google Lens search results

Google is also expanding AI Overviews in Lens search results. The company says “With help from our advanced AI models, Lens can go much further and provide information on the contents of more novel or unique images.”

Previously, AI Overviews in Lens searches only appeared when users combined text and images. Now, they will appear more frequently, even without a text query. 

To use this tool, users can tap the camera icon in the Search bar, snap a photo with Lens, and get an AI Overview with insights and links to more resources.

Google says this update is rolling out this week for English-language users in over 100 countries where AI Overviews are available. Availability will start on the Google app for Android and iOS, and coming soon to Chrome on desktop and mobile.

With the growing adoption of AI, Google has consistently updated its Lens product with AI-powered technology over the past year. In 2023, the company added AI-generated responses based on video and voice prompts. It also introduced a feature that displays product information directly on the results page.

‍