The Facing Emotions app translates the 7 key emotions detected on the human face, into 7 unique sounds - making it possible for the blind and visually impaired to have a richer experience and understanding when communicating with others.
The power of AI
Using the back cameras, the application scans the face of the person with whom the blind person is talking, and identify elements of the face: like eyes, nose, brows and mouth, along with their position in relation to each other.
AI then processes the identified emotion into a defined sound heard on the phone (or in the earphone the blind person is wearing). All of this happens in a real time and in offline mode.
It is only possible thanks to a powerful processor and AI, which Mate 20 Pro is equipped with.
The app doesn’t require an Internet connection to work. The process of recognising emotions is carried out on the basis of algorithms learned by AI within the Mate 20 Pro.
Interface for the blind
Black and yellow create the highest contrast, this combination is also recommended in accessibility guidelines
Yellow is the last colour visible to people with visual impairments or colour blindness
White is also a high contrast colour and is used to highlight the interactions and animations.
The app is available for Huawei Mate 20 Pro.