VideOSC is an experimental OSC* controller, using the color information retrieved from the video stream of the inbuilt backside camera of an Android-based smartphone (or tablet computer). The images coming in with the video stream are scaled down to a user-defined size (e. g. 5 x 4 pixels) and the RGB information of each pixel is sent to an OSC-capable application running on a computer within the local network.
From its current version 1.1 on VideOSC will also provide access to various sensors, such as orientation, accelerator, linear acceleration, magnetic field, gravity, proximity, light, air pressure, temperature, humidity and geo location. Of course, sensor support will dependent on the hardware of your device. Non available sensors will be marked as such.
VideOSC provides a non-interactive mode, in which all pixels will simply send their RGB information over the network, and one that allows to manually disable sending OSC messages for selected pixels.
Apart from that VideOSC may either send the RGB information of the original or the inverted image.
VideOSC does not provide any sound creation capabilities itself.
VideOSC should work with any OSC-capable software. Ideally this software allows algorithmic sound synthesis and control (e. g. SuperCollider, Pure Data, MaxMSP, etc.). In the project's Github repository
you will find a view (simple) usage examples using SuperCollider, Pure Data and MaxMSP in the folder "client_testing" that might help you to get going.
VideOSC is open source, licensed under the GNU GPL v3 - https://www.gnu.org/licenses/gpl-3.0.html
The application's source code is freely available at https://github.com/nuss/VideOSC
[*] Open Sound Control, a protocol for communication among computers, sound synthesizers, and other multimedia devices that is optimized for modern networking technology - http://opensoundcontrol.org