This project explores the use of video cameras and projectors and piezoelectric sensing to enable multiple-user musical interaction focused around a tabletop. For the initial prototype a mirror is mounted above a table at an angle such that a video projector mounted behind the table projects onto the table's surface. A webcam is also mounted behind the table and also uses the mirror to view the same surface. Using video tracking, objects placed on the table - and the hands of the users - may be used to interact with the system.
The software developed during initial exploration of the table interface allows an arbitrary number of objects or users to affect the system simultaneously. Rather than performing video blob tracking, video processing is used to generate a vector field from the web cam input, by which the dynamics of virtual objects or systems projected on the table may be influenced.
Hardware and software:
Joseph Malloch - http://www.music.mcgill.ca/~mallochj/
Stephen Sinclair - http://www.music.mcgill.ca/~sinclair/
For more information: http://www.idmil.org/projects/interactive_table