Write-Up coming soon. This is the way I've been doing my AV Collaborations, and I think it's got potential as part of a protocol to make these sorts of things easier. I'd love to nail down the nitty-gritty tech parts so we can all spend more time on the art and creation side of these things.

It currently works with MIDI being converted to a basic music language in Ableton Live (using custom Max4Live patches). Then Live speaks this language over OSC to a custom AIR Performance application called The Storyteller.