Just a proof of concept: By using a combination of 2d tracking and object tracking it is possible to have deforming face tracking in Blender.
Thanks Francois Tarlier for the hint and thanks Sergey for coding that within 4 hours. :)

Loading more stuff…

Hmm…it looks like things are taking a while to load. Try again?

Loading videos…