The 27th IPP Symposium
Flexible 3D Tracking for Faces and Other Blobs
Matthew Brand, MERL
Face tracking has applications in performance animation, low bit-rate video coding and unobtrusive interfaces. We approach the problem by relating nonrigid 3D motion directly to intensity changes in image sequences. A key idea is the use of matrix transforms to propagate image uncertainty all the way through calculations so that it can interact with the problem's geometric invariants. This yields a tracker that works robustly even in low-res, low-quality video, typically with sub-pixel accuracy.
