In what ways can the range of motion provided by the human body enable us to approach existing forms of media interaction from a fresh perspective? Sonoromancer explores this question by fusing ethereal visuals generated by the motion of a performer with ambient electronic instruments. The result is an interactive musical feedback experience.

The project explores how the motion of a human performer can provide feedback not just from the present moment, but from the echoes left by past motion. These echoes are visualized as plumes of energy within the performance space, inspiring the performer to move in an exploratory manner in order to create new trails of energy. The system obeys physical laws and demonstrates how inertia can become a driving factor in the control of the instrument, rather than relying solely on the specific intent of a performer. The interface also allows for learning through experimentation and performer directed patterns eventually arise from the resulting motions.

Sonoromancer harnesses abstract human motion to create a dynamic visual experience for synthesizing musical notes. Technologically, this is accomplished with the commonly available Kinect camera that allows for the tracking of humans through depth as well as colour. This is used to control a turbulent fluid through the spatial interaction of a performer with the system. The resulting visuals are used as both a representation of the forces controlling the creation of the musical patterns, as well as acting as an accompaniment for the generated audio.

Sonoromancer has been designed to augment existing musical technologies rather than attempting to redefine the role of the artist in the creation of electronic music. By building upon these pre-existing systems through the use of new mediums of interaction, Sonoromancer attempts to observe what may lie in store for the composers and performers of tomorrow.

Loading more stuff…

Hmm…it looks like things are taking a while to load. Try again?

Loading videos…