Audio-Video Integration for Background Modelling

This paper introduces a new concept of surveillance, namely, audio-visual data integration for background modelling. Actually, visual data acquired by a fixed camera can be easily supported by audio information allowing a more complete analysis of the monitored scene. The key idea is to build a multimodal model of the scene background, able to promptly detect single auditory or visual events, as well as simultaneous audio and visual foreground situations. In this way, it is also possible to tackle some open problems (e.g., the sleeping foreground problems) of standard visual surveillance systems, if they are also characterized by an audio foreground. The method is based on the probabilistic modelling of the audio and video data streams using separate sets of adaptive Gaussian mixture models, and on their integration using a coupled audiovideo adaptive model working on the frame histogram, and the audio frequency spectrum. This framework has shown to be able to evaluate the time causali...

• Type: Conference
• Year: 2004
• Where: ECCV
• Authors: Marco Cristani, Manuele Bicego, Vittorio Murino
• Keywords: Audio Foreground Entities, Computer Vision, ECCV 2004, Foreground Problems, Standard Visual Surveillance, Visual Foreground Situations, Visual Monitoring Approaches