MVMP: Multi-view Matching Pursuit with geometry constraints

Sets of multi-view images that capture plenoptic information from different viewpoints are typically related by geometric constraints. The proper analysis of these constraints is key to the definition of consistent compact representations of such images. We propose an algorithm for joint sparse approximation of multi-view images driven by epipolar geometry considerations. We extend greedy pursuit algorithms, such that the representation of multi-view images into linear combination of geometric atoms is able to balance approximation error and geometric consistency. We further add a rate penalty constraint that favors representations with small entropy towards efficient coding applications. Experimental results illustrate the trade-off between approximation, geometry and rate constraints in the representation of stereo omnidirectional images. In particular, we show that geometry constraints lead to a consistent description of the correlation among views, which is particularly beneficial...

• Type: Journal
• Year: 2010
• Where: ICIP
• Authors: Ivana Tosic, Antonio Ortega, Pascal Frossard
• Keywords: Consistent Compact Representations, ICIP 2010, Image Processing, Multi-view Images, Rate Constraint