Seeing AI

Microsoft Corporation

About this app

Seeing AI is a free app that narrates the world around you. Designed with and for the blind and low vision community, this ongoing research project harnesses the power of AI to open up the visual world by describing nearby people, text and objects.

Seeing AI provides tools to assist with a variety of daily tasks:
• Read - Hear text as soon as it appears in front of the camera. Document alignment provides audio cues to capture a printed page and recognize the text along with its original formatting. Ask Seeing AI about the contents to easily find the information you need.
• Describe - Take photos to hear a rich description. Ask questions to focus on the information you care about. Explore photos by moving your finger over the screen to hear the location of different objects.
• Products - Scan barcodes and Accessible QR codes using audio beeps to guide you; hear the product name and package information when available.
• People - Save photos of friends and coworkers so you can recognize them later. Get an estimate of their age, gender, and expression.
• Currency - Recognize currency notes.
• Colors - Identify colors.
• Light - Hear an audible tone corresponding to the brightness of your surroundings.
• Photos and Videos in other apps - Just tap “Share” and “Recognize with Seeing AI” to describe media from Mail, Photos, WhatsApp, and more.

Seeing AI continues to evolve as we hear from the community, and AI research advances.

Questions, feedback or feature requests? Email us at [e-mail].

Ratings and reviews

Dear Microsoft Team,I am a regular user of the Seeing AI app and find it to be a very useful tool for visually impaired individuals. I appreciate the efforts of the developers of this app.I would like to make a request. I would like you to add some new features to the app that could make it even more useful.Navigation Mode: In this mode, the app could provide voice-guided directions to the user, such as "Turn left," "Go straight," etc. This would make it much easier for visually impaired people

Thanks for the app! Wishlist for future versions: don't lock text recognition language to the device's system, allow for several packs to be downloaded and switching between languages in-app; ideally, make AI recognize the language used in scanned text and switch automatically or warn that the text's language doesn't match any installed pack. An integration with a translation service would be another step forward.

For an initial release of an app that has OCR, color detection, people count and description, scene description, and more, very impressive! One break or make test of an OCR app is out of focus text that isn't perfectly straight. Holding a bag of candies and scanning the ingredients, out of focus and not aligned, did quite well! Impressed and will be quite useful for those with limited vision or aging eyes. Definitely fast enough to be used besides magnifying glasses. Fun, fast, useful!

What’s new

We have updated the Seeing AI interface to make it faster to access the features you use the most.
The app is split into three tabs:
* Read: Provides tools for reading, combining the functionality of the previous Short Text, Document, and Handwriting channels.
* Describe: Provides rich descriptions of your surroundings, or photos already on your phone. This combines the functionality of the previous Scene and Person channels.
* More: Provides access to all the other task-specific channels.