Basic Spatial VJ Interface

This is my first experiment to explore how music and image can be experienced through spatial interaction.

NB. the audio and video are just the free samples from Resolume 4, i had nothing to do with making them. This is just a proof of concept and I hope to create/add my own music and visuals soon.

This is the first working attempt to use Processing to code a relationship between data from an Xbox Kinect motion sensor and the VJ software Resolume.

The program/sketch analyses the position of the hand in 3d space and sends this reparameterised information via OSC to control the volume and opacity of the 3 video and audio channels inside Resolume. The bounds of the interactive parameter space are adaptive, the user essentially pushes the extremes of the 'imaginary' box to define the size of space they are using.

There is also no intuitive or cognitive connection between the interaction and the outcome, the system relies on either experimentation or introduction. The conversation between technologies and the potential of Processing in general show how this set of tools could be used to develop much more complex and much more interesting interesting experiences/interactions.

Resolume 4 and its content is copyright of Resolume VOF © Resolume VOF 2000 - 2012. All rights reserved.

The Xbox® Kinect® trademark are the property of Microsoft Corporation®

Processing © is registered under a CreativeCommons licence. copyright Ben Fry and Casey Reas.