Automatic Recognition of Eye Blinking in Spontaneously Occurring Behavior

Previous research in automatic facial expression recognition has been limited to recognition of gross expression categories (e.g., joy or anger) in posed facial behavior under well-controlled conditions (e.g., frontal pose and minimal out-of-plane head motion). We have developed a system that detects discrete and important facial actions, (e.g., eye blinking), in spontaneously occurring facial behavior with non-frontal pose, moderate out-of-plane head motion, and occlusion. The system recovers 3D motion parameters, stabilizes facial regions, extracts motion and appearance information, and recognizes discrete facial actions in spontaneous facial behavior. We tested the system in video data from a 2-person interview. Subjects were ethnically diverse, action units occurred during speech, and out-of-plane motion and occlusion from head motion and glasses were common. The video data were originally collected to answer substantive questions in psychology, and represent a substantial challen...

• Type: Conference
• Year: 2002
• Where: ICPR
• Authors: Tsuyoshi Moriyama, Takeo Kanade, Jeffrey F. Cohn, Jing Xiao, Zara Ambadar, Jiang Gao, Hiroki Imamura
• Keywords: Computer Vision, Discrete Facial Actions, Facial Expression Recognition, ICPR 2002, Out-of-plane Head Motion