Integrated Event Recognition from Multiple Sources

This paper proposes a system architecture for event recognition that integrates information from multiple sources (e.g., gesture and speech recognition from distributed sensors in the real world). The proposed system consists of multiple recognizers named Continuous State Machines (CSMs). Each CSM has a state transition rule in a continuous state space and classifies time-varying patterns from a single source. Since the rule is defined as a simplification of Kalman filter (i.e., the next state is deduced from the trade-off scheme between input data and model's prediction), CSMs support dynamic time warping and robustness against noise. We then introduce an interaction method among CSMs to classify events from multiple sources. A continuous state space (i.e., vector space) allows us to design interaction as recursively minimizing an energy function. This interaction enables the system to dynamically focus over the multiple sources, and improves reliability and accuracy of classify...

• Type: Conference
• Year: 2002
• Where: ICPR
• Authors: Hiroaki Kawashima, Takashi Matsuyama
• Keywords: Computer Vision, Continuous State Space, Gesture Recognition Task, ICPR 2002, Multiple Sources