
Interactive Puppet Prototype with Xbox Kinect
1 year ago
Update: check the 2.0 version! vimeo.com/34824490
A quick installation prototype Emily and I hooked up with the libfreenect Kinect drivers and ofxKinect. The system is doing skeleton tracking on the arm and determining where the shoulder, elbow, and wrist is, using it to control the movement and posture of the giant funky bird!
Speed project - made in a day using openFrameworks and libFreenect.
Concept and Production by Design I/O
Emily Gobeille - Theo Watson
design-io.com
3D depth camera for arm tracking, courtesy of Microsoft and the open source / diy community :)
If you're interested in making projects with the Kinect and openFrameworks check out the addon as it progresses on the OF forums. openframeworks.cc/forum/viewtopic.php?p=24948#p24948
Also keep an eye on the libfreenect GitHub for latest updates to the driver - github.com/OpenKinect/libfreenect/
A quick installation prototype Emily and I hooked up with the libfreenect Kinect drivers and ofxKinect. The system is doing skeleton tracking on the arm and determining where the shoulder, elbow, and wrist is, using it to control the movement and posture of the giant funky bird!
Speed project - made in a day using openFrameworks and libFreenect.
Concept and Production by Design I/O
Emily Gobeille - Theo Watson
design-io.com
3D depth camera for arm tracking, courtesy of Microsoft and the open source / diy community :)
If you're interested in making projects with the Kinect and openFrameworks check out the addon as it progresses on the OF forums. openframeworks.cc/forum/viewtopic.php?p=24948#p24948
Also keep an eye on the libfreenect GitHub for latest updates to the driver - github.com/OpenKinect/libfreenect/
MOV
00:02:34
44 Related collections
- Categories / Animation & Motion Graphics
- Categories / Experimental
- EXPM - CHANNEL
- FX
- FAT Lab
- OpenFrameworks
| Date | Plays | Likes | Comments |
|---|---|---|---|
| Totals | 675K | 1,199 | 73 |
| Feb 23rd | 25 | 0 | 0 |
| Feb 22nd | 61 | 1 | 0 |
| Feb 21st | 103 | 1 | 0 |
| Feb 20th | 91 | 0 | 0 |
| Feb 19th | 82 | 0 | 0 |
| Feb 18th | 94 | 0 | 0 |
| Feb 17th | 125 | 0 | 0 |
-
Vimeo: About / Blog / Developers / Jobs /
Community Guidelines /
Help Center / Video School / Music Store / Site Map
/ Vimeo
or
-
Legal: TM + ©2012 Vimeo, LLC. All rights reserved. / Terms of Service / Privacy Statement / Copyright

Prev week
also we can do stuff when another person touches the projection, or is near - ie have the birds react, stare etc.
for the simple silhouette isolation you are right, the kinect just makes it super easy - but for what we have in mind there will be a lot of fun stuff we can add using the device.
Our research lab will be focused in developing a mixed reality framework with components as such depth camera interaction modules.
cadet.at
will be online next week...
posted on twitter.com/Vimeorussia
I would like to work on a more general approach to skeleton tracking, I think there is a lot of others working on this right now though :)
josesaenz.com
I'd be more than interested in working with you to create something that could interface with Blender 2.5 so the armature can be used for a real production environment.
Am interested in its implementation for markerless performance capture - with six or eight kinects linked up.
Good work and great stuff you did with nexus productions, congratulations on that.
nice to hear from you :)
Very cool! I have been waiting patiently for (and writing about) affordable digital puppets on console game systems ever since the Nintendo N64 was announced back in 1994. Your demo shows that we are getting closer and closer. Great work!
One technical question: is the cause of the lag due to the Kinect itself, or the Vision libraries? Or something else?
actually the lag is due to the fact we're using the old libfreenect driver which results in 8-12 fps video from the kinnect.
its actually been patched to run at 30fps now ( github.com/ofTheo/ofxKinect/pull/9 ) so with that patch the project runs with much much less noticeable lag.
:)
-----
"And I'm a Kinect hack made with a PC." youtu.be/M-wLOfjVfVc
:)
When you create a puppet animal - it leaps from your hand and then becomes its own animal - so you can create an animal zoo - birds, rabbits, snakes etc - they all have the behaviour of that animal.
Snakes chase birds, birds fly around etc. Anyways. Love your work as ever guys.
I keep meaning to try and find when you're going to be popping by work (nexus).
Will persevere!
Well done in the meantime!
so intriguing
this is going to open up story telling in an amazing way
O my... the possibilities... :-)