Sciweavers

MM
2009
ACM

Investigating the use of visual focus of attention for audio-visual speaker diarisation

13 years 9 months ago
Investigating the use of visual focus of attention for audio-visual speaker diarisation
Audio-visual speaker diarisation is the task of estimating “who spoke when” using audio and visual cues. In this paper we propose the combination of an audio diarisation system with psychology inspired visual features, reporting experiments on multiparty meetings, a challenging domain characterised by unconstrained interaction and participant movements. More precisely the role of gaze in coordinating speaker turns was exploited by the use of Visual Focus of Attention features. Experiments were performed both with the reference and 3 automatic VFoA estimation systems, based on head pose and visual activity cues, of increasing complexity. VFoA features yielded consistent speaker diarisation improvements in combination with audio features using a multi-stream approach. Categories and Subject Descriptors: H.3.1 [Content Analysis and Indexing]: Indexing methods.
Giulia Garau, Sileye O. Ba, Hervé Bourlard,
Added 28 May 2010
Updated 28 May 2010
Type Conference
Year 2009
Where MM
Authors Giulia Garau, Sileye O. Ba, Hervé Bourlard, Jean-Marc Odobez
Comments (0)