Sciweavers

Share
CVPR
2008
IEEE

3D face tracking and expression inference from a 2D sequence using manifold learning

9 years 21 days ago
3D face tracking and expression inference from a 2D sequence using manifold learning
We propose a person-dependent, manifold-based approach for modeling and tracking rigid and nonrigid 3D facial deformations from a monocular video sequence. The rigid and nonrigid motions are analyzed simultaneously in 3D, by automatically fitting and tracking a set of landmarks. We do not represent all nonrigid facial deformations as a simple complex manifold, but instead decompose them on a basis of eight 1D manifolds. Each 1D manifold is learned offline from sequences of labeled expressions, such as smile, surprise, etc. Any expression is then a linear combination of values along these 8 axes, with coefficient representing the level of activation. We experimentally verify that expressions can indeed be represented this way, and that individual manifolds are indeed 1D. The manifold dimensionality estimation, manifold learning, and manifold traversal operation are all implemented in the N-D Tensor Voting framework. Using simple local operations, this framework gives an estimate of ...
Wei-Kai Liao, Gérard G. Medioni
Added 29 May 2010
Updated 29 May 2010
Type Conference
Year 2008
Where CVPR
Authors Wei-Kai Liao, Gérard G. Medioni
Comments (0)
books