Seeing AI

Microsoft Corporation

About this app

Seeing AI is a free app that narrates the world around you. Designed with and for the blind and low vision community, this ongoing research project harnesses the power of AI to open up the visual world by describing nearby people, text and objects.

Seeing AI provides tools to assist with a variety of daily tasks:
• Short Text - Speaks text as soon as it appears in front of the camera.
• Documents - Provides audio guidance to capture a printed page, and recognizes the text, along with its original formatting. Ask questions about the contents to easily find the information you need.
• Products - Scans barcodes, or Accessible QR codes, using audio beeps to guide you; hear the name, and package information when available.
• Scenes - Hear an overall description of the scene captured. Tap "More Info" to hear an even richer description. Or, explore the photo by moving your finger over the screen to hear the location of different objects.
• People - Saves people’s faces so you can recognize them, and get an estimate of their age, gender, and expression.
• Currency - Recognizes currency notes.
• Colors - Identifies colors.
• Handwriting - Reads handwritten text like in greeting cards (available in a subset of languages).
• Light - Generates an audible tone corresponding to the brightness in the surroundings.
• Images in other apps - Just tap “Share” and “Recognize with Seeing AI” to describe images from Mail, Photos, Twitter, and more.
Seeing AI continues to evolve as we hear from the community, and AI research advances.

Check out tutorials with this YouTube playlist: http://aka.ms/SeeingAIPlaylist.

Visit http://SeeingAI.com for more details.

Questions, feedback or feature requests? Email us at [e-mail].

Ratings and reviews

For an initial release of an app that has OCR, color detection, people count and description, scene description, and more, very impressive! One break or make test of an OCR app is out of focus text that isn't perfectly straight. Holding a bag of candies and scanning the ingredients, out of focus and not aligned, did quite well! Impressed and will be quite useful for those with limited vision or aging eyes. Definitely fast enough to be used besides magnifying glasses. Fun, fast, useful!

I thought this was a God-send, at first. The document reader, especially. It has now begun producing nonsensical results or not recignizing that there are any letters at all. Even reproducing the text letts are spelled backwards or d9enst even comprise any word in the english language. Short text option is especially bad about this and 50$ detect8ng nothing at all. When it does read its gibberish. So disappointing....

Amazing! So much potential to improve the lives of countless individuals. There's just so much going on here. I LOVE the way it takes what I see as an ugly depressing scene and describes it in such a beautiful way. It's like the AI sees the physical world in its most true, raw, natural form, without the painful memories, without the longing, without the bias and the negativity. It just SEES everything how I wish I could see it. This is helping me be a more positive person! So much potential❤️‍🩹

What's new

Ask questions about photos (English only) - You can now ask Seeing AI questions about photos on the Scene channel, or those shared from another app.
Rich image descriptions, when you tap "More Info", have been improved to include even more details. Additionally, the names of people you have taught Seeing AI to identify are now included.
We have added 14 new languages, bringing the total to 33.