• Description
• 20 likes
• 2 comments
• View in Couch Mode

A preliminary test using FaceTracker to control a virtual camera within a 3D gaming or design environment. With some tuning, the effect could be made pretty convincing. The biggest obstacle is that FaceTracker looses non-front-facing faces. Perhaps the face detection training model could be extended. Failing this, it might be helpful to supplement the FaceTracker data with Kinect skeletal tracking to smooth or approximate the head position when necessary.

For this version, I ported ofxFaceTracker to Cinder and wrote a simple camera control system to interface with FaceTracker data. In the next revision, I'll integrate OpenNI data and add some motion blending and camera vector forces to improve the effect.

By shifting control of the camera position towards a motion vector rather than pure position-driven approach, it should be possible to diminish the apparentness of brief drops in face tracking. Some turbulence forces might also mask a freeze in face-controlled camera data.

Using Jason Saragih's FaceTracker library:

web.mac.com/jsaragih/FaceTracker/FaceTracker.html

Adapted for Cinder from Kyle McDonald's ofxFaceTracker:

github.com/kylemcdonald/ofxFaceTracker

My Cinder adaptation of ofxFaceTracker coming soon:
github.com/Hebali/ItpResidency

hebali.com

1. 
   Controlling a Virtual Camera with FaceTracker (ver. 2)
   by Patrick Hebron
2. 
   Digitalis: An Introduction to DEcomp (Side-by-Side Stereo 3D Edition)
   by Patrick Hebron
3. 
   Digitalis: An Introduction to DEcomp (Anaglyph Stereo 3D Edition)
   by Patrick Hebron
4. 
   MeandriCA by Morgen Fleisig & Patrick Hebron
   by Patrick Hebron
5. 
   3D Scan Volumetric Stylization - Patrick Hebron
   by Patrick Hebron
6. 
   Visible Human
   by Patrick Hebron
7. 
   Particle Bag - Dynamic Simulation
   by Patrick Hebron
8. 
   Conway's Game of Life - Gosper glider gun
   by Patrick Hebron
9. 
   CG Anaglyph Sample Render
   by Patrick Hebron
10. 
    Stereo Webcam Test (side-by-side)
    by Patrick Hebron
11. 
    Simple Self-Organizing Map of Randomized 2D Points
    by Patrick Hebron
12. 
    Evolutionary RPS: 50 players. 24 opponents. 7 matches.
    by Patrick Hebron