A quick installation prototype Emily and I hooked up with the libfreenect Kinect drivers and ofxKinect. The system is doing skeleton tracking on the arm and determining where the shoulder, elbow, and wrist is, using it to control the movement and posture of the giant funky bird!
Speed project - made in a day using openFrameworks and libFreenect.
Concept and Production by Design I/O
Emily Gobeille - Theo Watson design-io.com
3D depth camera for arm tracking, courtesy of Microsoft and the open source / diy community :)
This project aims at developing methods that enable natural communication over a distance without revealing one’s identity. The problem consists of two components: real-time generic face tracking and facial expression transfer (i.e. rigging). In order to be a useful tool for communication, the system must be capable of real-time performance on typical hardware (i.e. a laptop). The system should also enable users to generate their own avatars without too much effort of know how. The system requires only a single image of the desired avatar.
Visuals by Zach Lieberman, Francisco Zamorano, Andy Wallace, and Michelle Calabro.
(note: no post-production effects were used in this video. everything on the face is happening in real-time, via hacked Kinect, laptop and LED projector. It's built using FaceTracker code from Jason Saragih)