Just a proof of concept: By using a combination of 2d tracking and object tracking it is possible to have deforming face tracking in Blender. Thanks Francois Tarlier for the hint and thanks Sergey for coding that within 4 hours. :)
Hmm…it looks like things are taking a while to load. Try again?