A quick installation prototype Emily and I hooked up with the libfreenect Kinect drivers and ofxKinect. The system is doing skeleton tracking on the arm and determining where the shoulder, elbow, and wrist is, using it to control the movement and posture of the giant funky bird!
Speed project - made in a day using openFrameworks and libFreenect.
Concept and Production by Design I/O
Emily Gobeille - Theo Watson design-io.com
3D depth camera for arm tracking, courtesy of Microsoft and the open source / diy community :)
For the March 2010 issue of Boards Magazine, Emily Gobeille and I worked with Nexus Productions to develop an interactive cover experience called Rise and Fall. Here is a little preview of the experience.
[This video is a slightly expanded version of the one at vimeo.com/3793505. This version contains some extra behind-the-scenes views of the robot's motion planning system.]
"Double-Taker (Snout)" (interactive installation, 2008) deals in a whimsical manner with the themes of trans-species eye contact, gestural choreography, subjecthood, and autonomous surveillance. The project consists of an eight-foot (2.5m) long industrial robot arm, costumed to resemble an enormous inchworm or elephant's trunk, which responds in unexpected ways to the presence and movements of people in its vicinity. Sited on a low roof above a museum entrance, and governed by a real-time machine vision algorithm, Double-Taker (Snout) orients a supersized googly-eye towards passers-by, tracking their bodies and suggesting an intelligent awareness of their activities. The goal of this kinetic system is to perform convincing "double-takes" at its visitors, in which the sculpture appears to be continually surprised by the presence of its own viewers — communicating, without words, that there is something uniquely surprising about each of us.