I realized this project together with Thomas Heller as a term project in university. We created a cheap and easy solution for facial motion capture with decent results. Watch the above video for a finished animation and an explanation on how it has been made.
At first we experimented with an existing 8-camera-system and 3D tracking in Realviz Movimento. The tracked points have then been mapped onto a muscle-like shape, as seen in the video below. This shape then deformed the face of our test model. Our final solution uses a head-mounted rig and a high-speed camera for stabilization and to minimize the need for additional calculation after the capturing.
The third video was made in less than five days and has never been finished. But it proofs, that we can capture two different people and match their movement to their voice acting.
