This is a project I did this semester for a class in Audiovisual Systems, by professor Golan Levin. I used Tristan Jehan and Brian Whitman's Echo Nest API for most of the audio analysis and animated the video in Processing using Toxi's Vec3D library, Kristian Damkjer's OCD camera controls, and the jogl Java bindings for OpenGL.

The movements are timed to segment start times and duration, filtered by a threshold of attack emphasis (the fourth timbre basis function in Echo Nest Analysis). Colors are mapped by the first three timbre basis functions. The twelve glowing lights sources are mapped to the twelve pitches of the chromatic scale (regardless of octave modulation). The whole visualization is wrapped in a sphere with a custom lighting system so that all twelve lights shine on the walls to create ambient lighting.

Much thanks to Robert Hogin for posting his source code to Particle Emitter, which helped me considerably with 3D billboarding, to Golan for his continued support, to the folks at the Echo Nest for their hard work, and to Broken Social Scene for my use of their track.

Loading more stuff…

Hmm…it looks like things are taking a while to load. Try again?

Loading videos…