audible color is an audio-visual instrument. Sound is generated based on color detected by a camera. Red, green and blue correspond with certain music notes. When the colors are mixed, the resulting secondary colors produce different notes. The size of the colors influences the volume and frequency of the notes played. Color detection and sound generation were created and are controlled using Processing code.

Designed by Hideaki Matsui and Momo Miyazaki

Generative Design Workshop 2012 with Joshua Noble and Daviid Gauthier
Copenhagen Institute of Interaction Design (ciid.dk)

Full description:

Audible color is an audio-visual instrument. Sound is generated based on color detected by a web cam connected to a computer. Red, green and blue correspond with certain music notes. When the colors are mixed, the resulting secondary colors produce different notes. The size of the colors influences the volume and frequency of the notes played. Color detection and sound generation were created and are controlled using Processing code.

The system of audible color is based on a marriage between basic color and music theories. The colors of red, blue, and green are the visual foundation for color-mixing and the music notes A, D, and F are the base triad that corresponds to the colors. The secondary colors (colors made when the foundational three are mixed) of purple, teal and brown are tuned to the musical triad C, E and G. The visual of the mixing of red, blue and/or green mirrors the aural output of combined notes.

The ‘painting’ aspect is not restricted to water droplets from a pipette. Numerous experiments were performed using substances such as acrylic paint, food dye in milk with soap, and ordinary household objects. Each investigation created a new type of fun and easy gestural music-making.

Project page:
http://ciid.dk/education/portfolio/idp12/courses/generative-design/projects/audible-color/