MirrorFugue a project from the Tangible Media Group at the MIT Media Lab. It includes a set of interfaces for the piano to visualize the gesture of a performance. Based on the idea that the visibility of gesture contributes to learning and synchronization, MirrorFugue displays the hand and body movements of piano playing using metaphors from the physical world to connect musicians from disparate spaces and times.

We designed two modes to visualize the hand gesture of a performance, which we term "Reflection" and "Organ". Inspired by the reflective surface on a lacquered grand piano that mirrors the keyboard and player's hands, Reflection mode shows the mirrored keyboard and hands of a performance. Organ mode displays the unaltered, top-town image of the collaborator's keyboard like the aligned and offset keyboards of an organ.

MirrorFugue can be used in remote lessons to enable teachers and students to see each other's playing. It could also be used to playback recordings of the self and others. A student can use MirrorFugue for practice support by recording a portion of a piece playing a duet with the recording. By displaying the body and the hands at full scale on the surface of the instrument, MirrorFugue evokes the presence of a pianist with a sense of intimate emotional expression.

For more information: web.media.mit.edu/~x_x/mirrorfugue/

Loading more stuff…

Hmm…it looks like things are taking a while to load. Try again?

Loading videos…