Microsoft’s Seeing AI app is now available for the first time on Android devices, expanding its accessibility beyond iOS. The app, which can be downloaded from the Google Play Store, aims to assist blind and low-vision individuals in comprehending the world around them through AI-powered narration using their smartphone’s cameras. Leveraging Microsoft’s latest advances in generative AI, the Android version mirrors the features of its iOS counterpart. With over 3 billion Android users worldwide, the app has the potential to significantly enhance the quality of life for many individuals.
The app’s recent enhancements were developed based on user feedback, resulting in more detailed image descriptions. By default, Seeing AI delivers a concise summary of a photo’s contents. Users can access a more comprehensive description by tapping the “more info” icon. Additionally, swiping a finger over the screen enables the app to provide information about the locations of various objects. The app also supports importing photos from other applications.
In response to user feedback, Microsoft has introduced a new feature that allows users to ask questions about a document using Seeing AI. After scanning a document, users can inquire about specific details, such as menu items or the cost of items on a bill. Additionally, users have the option to ask the app to summarize a scanned article. The app offers audio guidance on how to scan a printed page effectively.
Seeing AI provides various methods for users to explore their surroundings using their device’s camera. For example, the app reads out short pieces of text as soon as the camera detects them. It also has the capability to scan barcodes, offering product information, including names and details from packaging when available. This functionality can be particularly beneficial, such as when dealing with medication.
Moreover, the application can assist in recognizing individuals, including interpreting their facial expressions, identifying currency, discerning colors and brightness levels. Furthermore, Seeing AI exhibits the capability to read handwritten text in certain languages.
The launch of Seeing AI on Android coincides with the International Day of People with Disabilities. Currently, the app supports 18 languages: Czech, Danish, Dutch, English, Finnish, French, German, Greek, Hungarian, Italian, Japanese, Korean, Norwegian Bokmal, Polish, Portuguese, Russian, Spanish, Swedish, and Turkish. Microsoft has outlined plans to expand language support to 36 languages by the year 2024.
