How to distinguish posed from spontaneous smiles using geometric features

Automatic distinction between posed and spontaneous expressions is an unsolved problem. Previously cognitive sciences’ studies indicated that the automatic separation of posed from spontaneous expressions is possible using the face modality. However, little is known about the information from head and shoulder motion. In this work, we propose to (i) distinguish between posed and spontaneous smiles by fusing head, face, and shoulder modalities, (ii) investigate which modalities carry important information and how the modalities relate to each other, and (iii) to which extent the temporal dynamics of these signals attribute to solving the problem. A cylindrical head tracker is used to track head motion and two particle filtering techniques to track facial and shoulder motion. Classification is performed by kernel methods combined with ensemble learning techniques. We investigated two aspects of multimodal fusion: the level of ion (i.e., early, mid-level, and late fusion) and the fus...

• Type: Conference
• Year: 2007
• Where: ICMI
• Authors: Michel François Valstar, Hatice Gunes, Maja Pantic
• Keywords: ICMI 2007, Shoulder Motion, Spontaneous Expressions, Spontaneous Smiles