Guided Vision in Gemini Live: built for accessibility

Google has launched Guided Vision in Gemini Live, a conversational visual interpretation feature for people who are blind, have low vision, or want intuitive visual assistance. Developed through close collaboration with accessibility community — including a partnership with Aira that involved tens of thousands of hours of visual interpretation data and over 1,000 Trusted Tester members stress-testing the model — Guided Vision lets users share their camera during a Gemini Live session to hear real-time descriptions of their surroundings, ask detailed follow-up questions, and receive spoken cues to reframe the camera. It supports everyday tasks such as reading fine print and nutrition labels, finding dropped objects, describing colors and patterns for outfit coordination, and exploring unfamiliar environments, with conversations available in multiple languages following testing with communities across India, Brazil, Singapore, Indonesia, and Japan. The feature is accessible via the Gemini app settings, Android accessibility shortcuts (including the floating accessibility button, two-finger swipe, or both volume keys), and TalkBack integration. Google emphasizes that Guided Vision is an assistive utility and not a medical device, mobility aid, or white cane replacement, and it is not intended for navigation, safe-travel guidance, or obstacle detection. It is now available on Android 9+ devices in regions and languages where Gemini Live is supported.

(Source：Gemini)