Look to Speak

Google Creative Lab

About this app

Look to Speak is an Android app from Google which enables you to use your eyes to select a menu of phrases and pictures and have them spoken aloud. The app uses the front-facing camera to detect eye gaze gestures, processing the feed in real time using machine learning. When a significant gesture is detected, the app will trigger your intended action. All data is private and never leaves the device.

Ratings and reviews

The look left right up for navigation is good. But it lacks a typing by eyes mode. I had to write the alphabet by myself, but that doesn't have a word or sentence forming assist feature, so I have to write each letter down manually. Good app, but it needs more features. If you open source this or provide eye tracking API, that would be great, so I can modify it to suit my mom's needs.

To be frank the app works quite well but you have to look at the extremes a lot... The iris detector should be more sensitive because there is only very small angle between the left and the right extreme of the device which we use... Not only that since the angle depends on the distance between our head and the device... The app should also specify the right distance in order for working efficiently!

To be able to help paralyzed people around the world to speak, other languages shall be added. And to make it useful for paralyzed children (who dont know how to read) a selection between list of symbols of basic essential needs can be added in addition to the list of words. Recognizing head movement to add more commands could also be a good option to add. Great job, keep it up

What’s new

The new text-free mode allows you to select a choice of emojis, symbols and photos to be spoken aloud - with no reading required. The update also includes the ability to store multiple phrasebooks and added support for Swahili.