An improvised audio-visual (interactive dance) performance by Joshua B. Mailman, employing the Fluxations interactive system developed by him and Sofia Paraskeva.
Movement around the stage (left vs. right and forward vs. backward) affects harmony and colors. Flex of the right wrist and body posture (upright vs. lowered) affect texture of the music and visuals. Flex of the left wrist affects rhythm of the music and visuals.
Recorded in the Columbia Computer Music Center of Columbia University, NYC, June 2012
The finale (part 3) of an improvised duet performed with FluxNoisations and circuit-bent radio
(for front on view of the complete performance visit: youtube.com/watch?v=8eBra9gd5QQ )
No recordings, audio samples, or videos are used.
All sounds and graphics are generated in the moment of performance.
Joshua Banks Mailman and Luke Thomas Taylor present an extended improvised performance of high-tech and low-fi pulsating spatialized noise. The event includes improvised live computer graphics, a colorful spectacle projected on a large screen, controlled by spontaneous body- and hand-movements of Mailman, through his FluxNoisations interactive-dance system. Through this system, Mailman simultaneously generates and steers a stream of percussive-noise sound. Interacting with this, Taylor performs on his own devised noise instrument: a circuit board he plays with wet hands. Through micro-fluctuations of the movement, pressure, and moisture of Taylor's hands, the circuit board displays its hidden potential—a sound world with chaotic connectivity of rich noises, clicks, and glissandos.
Joshua B. Mailman: FluxNoisations (sounds of wood, metal, water, sandpaper, sticks, etc. and live computer graphics controlled through infrared camera motion-capture and sensor gloves)
Luke T. Taylor: circuit-bend radio (dismantled analog radio played with wet hands)
FluxNoisations interactive system (sound and graphics): Designed and programmed by Joshua B. Mailman
Sensor gloves: Designed, programmed, and built by Sofia Paraskeva
Recorded at Lotte Lehmann Concert Hall, University of California, Santa Barbara, May 30, 2013
Sound recording: Fernando Rincon Estrada
Video Documentation: Joel Hunt and Laura Emmery
Mixing and editing: Joshua B. Mailman
This video should be heard with Left/Right stereo separation, either through headphones/earbuds or with physically separated left and right speakers
To understand more of what's happening, watch the beginning (0:00-1:50) of the performance, which better conveys the interactivity: vimeo.com/fluxations/FluxNOISnycemf2015
The FluxNOISations system is based on a previous interactive system, Fluxations, developed by Joshua B. Mailman and Sofia Paraskeva (since 2012) and algorithms by Mailman (since 2011). The graphics and sound programming in both systems (Fluxations and FluxNOISations) was done by Joshua B. Mailman. Both systems employ the wireless sensor gloves designed, programmed, and constructed by Sofia Paraskeva. In both systems the interactivity is controlled by motion tracking of the whole body (including hands) by infrared video technology (not gloves). Paraskeva's wireless gloves sense flexing of the wrist and enable various on/off and mode controls and triggers of the custom software. For more on the philosophy behind Fluxations and FluxNOISations, see "Improvising Synesthesia" (2013) leoalmanac.org/wp-content/uploads/2013/07/LEAVol19No3-Mailman.pdf
in _Leonardo_Electronic_Almanac_ v.19/3 leoalmanac.org/vol19-no3-live-visuals/