Inspired by V-Motion project (
The hit-test still use a brute-force approach: filter the depth, traverse each depth pixels, transform to polar coordinates, then do the usual AABB hit-testing in polar coordinates.
The program outputs custom OSC messages, which are then translated to MIDI message using a PureData patch. The MIDI message is then routed to synthesizer software (I use Propellerhead Reason for this PoC). Internal MIDI routing in Windows is done using MidiYoke.
The latency is quite reasonable, although the delay can still be noticed (perhaps around 5 ms or so).
Built using openFrameworks 0073 and Microsoft Kinect SDK 1.6 on Visual C++ 2010 Express.
In collaboration with Grace Sahertian (

Loading more stuff…

Hmm…it looks like things are taking a while to load. Try again?

Loading videos…