Kellyn Loehr and I decided to explore using pieces of video as a particle system. A user loads in their source footage and a song, and the program separates the video into pieces that react both to the fft of the song as well as each other. We have several modes of this exploration on view in this example.
Moving forward we would like to include more of a gui interface for users to easily upload their own movie and music files from their hard drives. We would also like to push the fft reaction to be more organic and noticeable to the music.