Sonified Interactions (Me + Chair) is an investigation into performative research and the computer’s gaze. Using the built-in webcam as an input for what the computer sees, motion tracking and code as a translator for what it understands, and sound as its mode of communication; I am sonifying the computer’s gaze in realtime in an abstract, but relative way.
As the video begins, the sound is overly present; loud and abstract. Then, I move, and the sound seems to bend with my body. The frequencies mimic the altering of the physical space as I change the composition of the room and frame. The slower actions, like scooting across the frame, bring out a cinematic tension that feels like a soundtrack to a movie, where as I associate the the quicker actions with special-effect-like accents. While I was performing, I thought of using the chair and my body like an instrument to get a desired sound. However, that is not the intention of this project and the only sound I desire is one that represents the actions in the frame.
If I were to continue iterating, I would further develop the code so the sound would have a wider vocabulary, while still being abstract. I would also explore new interactions between myself and the chair. And lastly, I would build an archive of the same actions using different chairs to investigate the subtle differences in my approach to interacting with similar forms.
The low image quality is because the video was screen captured at 180x100px and scaled up.