00:00
293
More
See all Show me
This is a project I did this semester for a class in Audiovisual Systems, by professor Golan Levin. I used Tristan Jehan and Brian Whitman's Echo Nest API for most of the audio analysis and animated the video in Processing using Toxi's Vec3D library, Kristian Damkjer's OCD camera controls, and the jogl Java bindings for OpenGL.

The movements are timed to segment start times and duration, filtered by a threshold of attack emphasis (the fourth timbre basis function in Echo Nest Analysis). Colors are mapped by the first three timbre basis functions. The twelve glowing lights sources are mapped to the twelve pitches of the chromatic scale (regardless of octave modulation). The whole visualization is wrapped in a sphere with a custom lighting system so that all twelve lights shine on the walls to create ambient lighting.

Much thanks to Robert Hogin for posting his source code to Particle Emitter, which helped me considerably with 3D billboarding, to Golan for his continued support, to the folks at the Echo Nest for their hard work, and to Broken Social Scene for my use of their track.

Credits

Likes

See all likes
  • whitekross 3 years ago
    really nice! this is great
  • Eamae Mirkin 3 years ago
    Hey thanks a lot!
  •  
  • lukasz plus 3 years ago
    looks great... like the way u've mapped the colours.
  • Eamae Mirkin 3 years ago
    Thanks
  •  
  • Jordan Snyder 3 years ago
    brilliant
  •  
  • Corrado 3 years ago
    amazing work
    C.
  •  
  • Lee Byron 3 years ago
    This came out really fantastic
  •  
  • blackpawn plus 3 years ago
    cool man
  •  
  • suprb 3 years ago
    Yum!
  •  
  • TST-Blade 3 years ago
    Wow realy Great !!!
  •  
  • ilter 3 years ago
    It looks promising. I wonder how acurate it could be and how much modifiable it is. It could be a great tool for some music and audio production related stages.
    If you are interested in cooperation and have time for improvement, don't hesitate to contact me, I'm into audio & music production.
    Take care!
  •  
  • phreakhead 3 years ago
    What song is this?
  • YĆ«co 1 year ago
    7/4. The group is Broken Social Scene. Is in the credits.
  •  
  • Ryan Hartsock 2 years ago
    Beautiful, stunning piece.
  •  
  • Brennan L. 2 years ago
    It's like Animusic!

    Namely, this particular piece:

    video.google.com/videoplay?docid=2942922314315974986

    (Shame, it's not vimeo hi-def.)

    Really cool!
  •  
  • Dorian 2 years ago
    i like it!!!.... hope can do what u do soon!! is so inspiring!!!
  •  
  • Satya Meka plus 2 years ago
    Hey Eamae, how did you get that volumetric light in processing? did you use open gl additive blending?
  • Eamae Mirkin 2 years ago
    Good question. The short answer is that it's not actually volumetric. The colored point "lights" are just billboarded textures, with additive blending. Then the whole scene is wrapped in a giant sphere, and lit with point lights in the same positions as the billboards. At the time I was painfully new to open gl, so I chose to write my own lighting engine, rather than figure out how to use gl lighting. Basically, every vertex calculates it's color based on the distance from each light source, additively. This part happens on the processor though, not the graphics card, so it's not as fast.

    If you're interested real (well, virtually real) volumetric lighting, you should check out sunflow render engine:
    hipstersinc.com/p5sunflow/.
  • Satya Meka plus 2 years ago
    Great! I figured it wasn't real volumetric light, but was curious how you pulled it off.
  •  
  • rybotron plus 2 years ago
    Love this.
  •  
  • Awankidd 1 year ago
    wow....wow.....keren
  •  
This conversation is missing your voice. Take five seconds to join Vimeo or log in.

Advertisement

About this video

FLV
00:04:53
  • 504x336, 19.52MB
  • Uploaded Fri May 09, 2008
  • Please join or log in to download

Statistics

Date Plays Comments
Totals 7,364 120 21
Feb 15th 0 0 0
Feb 14th 2 0 0
Feb 13th 5 0 0
Feb 12th 2 0 0
Feb 11th 0 0 0
Feb 10th 2 0 0
Feb 9th 1 0 0