This is a short clip of the Little SIS installation running at the SEAM Symposium 2010 held at the Seymour Centre in Sydney. The syllabic sound you can (sort of) hear is generated in real-time based on the movement of the participants in the space, as are the visuals on the screen. We have been experimenting with different ways of displaying this work, mostly using projection, but thought it was worth trying it on a screen. There is a lot of background noise as there was a robot installation by Stelarc just behind the camera.

The camera tracking was done using openFrameworks. The visuals and sound control was done in Processing. Sound was made from samples of phonemes that were put back together on the fly to create nonsense words. The samples were played back from Ableton Live controlled via midi from Processing. oF and Processing communicated via OSC.