A new iPhone app uses your surroundings to remix the music you're listening to.
"Sadly by your side" is an interdisciplinary art project encompassing an album, a book, and an iPhone app. It's written by David Cairo and produced by Fabrica, a design and communications strategy firm based in Italy. There are two different ways to listen to the album using the iPhone app, both of which require that you use the iPhone's camera. To hear the album exactly as Cairo intended it, simply hold the camera up to the book, it'll lock on, and playback the original version.
The more experimental route is to use the information hitting the camera sensor as the basis for a remix of the music.The app breaks up the image the camera is seeing into a mixture of black, blue, and red, each of which controls different parameters of the music. The underlying code for each track is programmed so that the data visualization affects the harmony, melody, and rhythm of the track differently.