Animatic is a research project in digital puppetry for real time puppet animation made in 2007.
The result prototype application simulates the control of a marionette with strings or rods with face animation using several interfaces, like:
keyboard, mouse, microphone, gamepad, and a WII Remote controller
This application is based on a puppet theater show, made in 3D with a dynamics engine for multi-platform, with the implementation of animated lights and animated cameras, switching and moving in real time.
There are objects in the scene that can interact with the marionette using collision detection.
The puppet is connected with springs giving more life to the puppet
To simulate the rod manipulation, the mouse can be used to move any part of the body.
A simple mouse drag of the body members, give a full control of the puppet, but with the limitation of one mouse movement at a time.
Lip sync was also implemented for face expression.
A classifier was builded with a Fast Fourier Transform algorithm for real time analysis.
To simulate the strings manipulation the gamepad can be used to interact with the controller.
This controller was named Piano matic because of the keys connected to the controller witch connects the strings to the body.
Moving the joystick of the gamepad lift a key and move a part of the body.
The head can also aims to the mouse pointer
The Wii remote controller is used for generic movement of the puppet.
This is the easiest way for moving the marionette with a very natural interface giving a great experience to the users.
Its possible to use all the interfaces at the same time with different users.
for more information: grifu.com/animatic