Automatic multi-modal dialogue scene indexing

12 years 1 months ago
Automatic multi-modal dialogue scene indexing
An automatic algorithm for indexing dialogue scenes in multimedia content is proposed. The content is segmented into dialogue scenes using the state transitions of a hidden Markov model (HMM). Each shot is classified using both audio and visual information to determine the state/scene transitions for this model. Face detection and silence/speech/music classification are the basic tools which are utilized to index the scenes. While face information is extracted after applying some heuristics to skin-colored regions, audio analysis is achieved by examining signal energy, periodicity and zero crossing rate (ZCR) of the audio waveform. The simulation results show the possibility of automatically indexing the dialogues using the proposed algorithm.
A. Aydin Alatan
Added 25 Oct 2009
Updated 25 Oct 2009
Type Conference
Year 2001
Where ICIP
Authors A. Aydin Alatan
Comments (0)