Apple is set to introduce a new feature called ‘visual intelligence’ on its upcoming iPhone 16 models. The feature will allow users to perform visual searches and text recognition from their devices. 

At an Apple event, Craig Federighi, Apple’s Senior Vice President of Software Engineering, said with ‘visual intelligence,’ users can “instantly learn about everything,” they see.

Apple’s ‘visual intelligence’ tool looks like Google Lens, which launched in 2017. Google Lens provides search results and information when users point their phone's camera at any object. 

What is Apple’s ‘visual intelligence’ and how will it be accessible?

The ‘visual intelligence’ feature is a tool that brings advanced image-based search capabilities to iPhone 16 users. According to Apple, this feature allows users to carry out visual searches that can analyze objects, landmarks, text, and more using the new Camera Control button.

To activate the feature, users can press and hold the button while aiming their phone’s camera at any object. Federighi said it can capture “details like title, date, and location” on event flyers.  

Integration with ChatGPT for advanced queries

Apple's ‘visual intelligence’ uses search tools like ChatGPT to deliver search results. This integration will allow users to send their visual queries directly to ChatGPT for more complex searches. Federighi explained that the feature is “also your gateway to third-party” models. 

Privacy and data protection

Apple has emphasized that ‘visual intelligence’ will protect user privacy by not storing images processed by the feature on its servers. User data will be private and secure. 

When will Apple roll out its ‘visual intelligence’ feature?  

Apple says that the ‘visual intelligence’ feature will be rolled out in October 2024 for users in the United States, with plans to expand to other regions by December.  iPhone 16 users worldwide will soon have the opportunity to use this tool.