The Kromophone is a color sonification device. This means it turns colors into sounds. It's a sensory substitution device, which means it turns sensory perceptions from one modality (i.e., color vision) into sensations in another (in this case, auditory perceptions).

The Kromophone was developed for its users to be able to get around and make sense of their environment purely by auditory sensation. A secondary (but important) goal was to allow users a pleasing experience of visual artwork while blindfolded.

The Kromophone will take visual input from the camera and produce sound output. Development is underway for more mobile versions running on Android, Raspberry Pi, and even some custom hardware.

The Kromophone takes the intensities of five different colors that you see (red, green, blue, yellow, and white) and maps them to the volume of five different sounds (high pitched trumpet, medium pitched violin, low pitched tuba, medium-high pitched organ, medium pitched tone). As the intensities of the colors in front of the camera change, the volume of these different colors change.
Read more
Loading...

Additional Information

Updated
July 28, 2016
Size
Varies with device
Installs
50+
Current Version
Varies with device
Requires Android
Varies with device
Content Rating
Everyone
Permissions
Offered By
Zachary Capalbo
©2018 GoogleSite Terms of ServicePrivacyDevelopersArtistsAbout Google
By purchasing this item, you are transacting with Google Payments and agreeing to the Google Payments Terms of Service and Privacy Notice.