“AI Mode builds on our years of work on visual search and takes it a step further,” says Robby Stein, VP of product for Google Search. “With Gemini’s multimodal capabilities, AI Mode can understand the entire scene in an image, including the context of how objects relate to one another and their unique materials, colors, shapes, and arrangements.”

Google is offering access to AI Mode in Google Search to free users in the US. It also brings multimodal visual queries via Google Lens.

Google AI mode now understands images, allowing you to upload photos and ask questions about them. AI Mode is rolling out to more people.