This is an edited ~10min version of a 40 minute audio visual improvisation between Roberto Morales (piano, flute, Wii-controllers, custom SuperCollider audio software), Renato Vacirca (drums & percussion) and Matt Gingold (drum samples, robotic solenoid percussion, custom openFrameworks video software).
Roberto's software takes audio input from microphones and direct input, allowing him to control not only the mix but also generative compositional algorithms via Wii-controller. Audio analysis and midi control data are passed to my computer, which allows me to route signals to various parts of the video playback, as well as control drum samples and solenoid triggers.
The video software I am using was developed in openFrameworks, and is using openCL effects (blur, color, sat, bright, etc) and particle masks. It is controlled using a midi keyboard and drum pads. The 10 solenoids (which can't really be seen) are controlled by either of these instruments and were attached to various surfaces of the Book (welltheatre.com) - metal, wood, plastic, etc - to provide percussive elements.
Renato plays amazing drums with his completely custom organic human bio software.
Hard to tell where one starts and the other finsihes at times, even for us!