Motion Segmentation with Missing Data Using PowerFactorization and GPCA

We consider the problem of segmenting multiple rigid motions from point correspondences in multiple affine views. We cast this problem as a subspace clustering problem in which the motion of each object lives in a subspace of dimension two, three or four. Unlike previous work, we do not restrict the motion subspaces to be four-dimensional or linearly independent. Instead, our approach deals gracefully with all the spectrum of possible affine motions: from twodimensional and partially dependent to four-dimensional and fully independent. In addition, our method handles the case of missing data, meaning that point tracks do not have to be visible in all images. Our approach involves projecting the point trajectories of all the points into a 5dimensional space, using the PowerFactorization method to fill in missing data. Then multiple linear subspaces representing independent motions are fitted to the points in R5 using GPCA. We test our algorithm on various real sequences with degenerate...

• Type: Conference
• Year: 2004
• Where: CVPR
• Authors: René Vidal, Richard I. Hartley
• Keywords: Computer Vision, CVPR 2004, Independent Motions, Multiple Rigid Motions, Possible Affine Motions, Subspace Clustering Problem, Transparent Motions