Audio, Video and Multimodal Person Identification in a Smart Room

In this paper, we address the modality integration issue on the example of a smart room environment aiming at enabling person identification by combining acoustic features and 2D face images. First we introduce the monomodal audio and video identification techniques and then we present the use of combined input speech and face images for person identification. The various sensory modalities, speech and faces, are processed both individually and jointly. It's shown that the multimodal approach results in improved performance in the identification of the participants.

• Type: Conference
• Year: 2006
• Where: CLEAR
• Authors: Jordi Luque, Ramon Morros, Ainara Garde, Jan Anguita, Mireia Farrús, Dusan Macho, Ferran Marqués, Claudi Martinez, Verónica Vilaplana, Javier Hernando
• Keywords: Biometrics, CLEAR 2006, Face Images, Person Identification, Video Identification Techniques