SoundTracks is an interactive interface and program for creating, storing and replaying animated drawings with sound. I developed it to use with long-time friend and visual artist, Ann Chamberlain, who suffered severe memory impairment due to metastasized breast cancer. The interface was created to re-establish and maintain a meaningful personal connection with Ann as well as to find a way for her to continue working as an artist by increasing and sustaining her ability to focus and concentrate for extended periods of time.
A piece of paper was placed on the tablet surface at the beginning of each drawing session. Ann drew directly onto the paper with a special pen, which tracked her movements as she created the drawing. So a drawing on paper was created for each of the animated drawings with sound. These are the 42 drawings on paper with a short audio excerpt from one of the drawings.
Ann Chamberlain: drawing.
Brenda Hutchinson- interface design, programming, audio recording, instrument design, camera.
FYI- Beginning with a Wacom drawing tablet and a MAX/MSP object written by Jean-MichelCouturier.1 I wrote a series of programs in MAX/MSP that make it possible to assign sampled sounds to regions on a two dimensional area corresponding to the surface of the Wacom tablet. Once sounds are assigned, the movement of the hand (holding the Wacom pen) is tracked as it initiates and scrubs through the sampled sounds. The data of the movement is recorded and stored as x/y coordinates over time. This data can be replayed through the SoundTracks drawing program, and it will recreate the animated drawing with sound in real time.