Modeling Human Activities as Speech

10 years 7 months ago
Modeling Human Activities as Speech
Human activity recognition and speech recognition appear to be two loosely related research areas. However, on a careful thought, there are several analogies between activity and speech signals with regard to the way they are generated, propagated, and perceived. In this paper, we propose a novel action representation, the action spectrogram, which is inspired by a common spectrographic representation of speech. Different from sound spectrogram, an action spectrogram is a space-time-frequency representation which characterizes the short-time spectral properties of body parts’ movements. While the essence of the speech signal is the variation of air pressure in time, our method models activities as the likelihood time series of action associated local interest patterns. This low-level process is realized by learning boosted window classifiers from spatially quantized spatio-temporal interest features. We have tested our algorithm on a variety of human activity datasets and achieved ...
Chia-Chih Chen, Jake Aggarwal
Added 30 Apr 2011
Updated 30 Apr 2011
Type Journal
Year 2011
Where CVPR
Authors Chia-Chih Chen, Jake Aggarwal
Comments (0)