Functional Categorization of Objects using Real-time Markerless Motion Capture

Unsupervised categorization of objects is a fundamental problem in computer vision. While appearance-based methods have become popular recently, other important cues like functionality are largely neglected. Motivated by psychological studies giving evidence that human demonstration has a facilitative effect on categorization in infancy, we propose an approach for object categorization from depth video streams. To this end, we have developed a method for capturing human motion in real-time. The captured data is then used to temporally segment the depth streams into actions. The set of segmented actions are then categorized in an unsupervised manner, through a novel descriptor for motion capture data that is robust to subject variations. Furthermore, we automatically localize the object that is manipulated within a video segment, and categorize it using the corresponding action. For evaluation, we have recorded a dataset that comprises depth data with registered video sequences for 6 s...

• Type: Journal
• Year: 2011
• Where: CVPR
• Authors: Juergen Gall, Andrea Fossati, Luc VanGool
• Keywords: Categorization, Computer Vision, CVPR 2011, Motion Capture Data, Unsupervised Categorization