Sciweavers

Share
ICASSP
2011
IEEE

Unsupervised extraction of audio-visual objects

8 years 3 months ago
Unsupervised extraction of audio-visual objects
We propose a novel method to automatically detect and extract the video modality of the sound sources that are present in a scene. For this purpose, we first assess the synchrony between the moving objects captured with a video camera and the sounds recorded by a microphone. Next, video regions presenting a high coherence with the soundtrack are automatically labelled as being part of the source. This represents the starting point for an innovative video segmentation approach, whose objective is to extract the complete audiovisual object. The proposed graph-cut segmentation procedure includes an audio-visual term that links together pixels in regions with high audio-video coherence. Our approach is demonstrated on challenging sequences presenting non-stationary sound sources and distracting moving objects.
Anna Llagostera Casanovas, Pierre Vandergheynst
Added 21 Aug 2011
Updated 21 Aug 2011
Type Journal
Year 2011
Where ICASSP
Authors Anna Llagostera Casanovas, Pierre Vandergheynst
Comments (0)
books