Predicting 3D People from 2D Pictures

11 years 5 months ago
Predicting 3D People from 2D Pictures
Abstract. We propose a hierarchical process for inferring the 3D pose of a person from monocular images. First we infer a learned view-based 2D body model from a single image using non-parametric belief propagation. This approach integrates information from bottom-up body-part proposal processes and deals with self-occlusion to compute distributions over limb poses. Then, we exploit a learned Mixture of Experts model to infer a distribution of 3D poses conditioned on 2D poses. This approach is more general than recent work on inferring 3D pose directly from silhouettes since the 2D body model provides a richer representation that includes the 2D joint angles and the poses of limbs that may be unobserved in the silhouette. We demonstrate the method in a laboratory setting where we evaluate the accuracy of the 3D poses against ground truth data. We also estimate 3D body pose in a monocular image sequence. The resulting 3D estimates are sufficiently accurate to serve as proposals for the ...
Leonid Sigal, Michael J. Black
Added 20 Aug 2010
Updated 20 Aug 2010
Type Conference
Year 2006
Where AMDO
Authors Leonid Sigal, Michael J. Black
Comments (0)