Aligning Spatio-Temporal Signals on a Special Manifold

11 years 10 months ago
Aligning Spatio-Temporal Signals on a Special Manifold
We investigate the spatio-temporal alignment of videos or features/signals extracted from them. Specifically, we formally define an alignment manifold and formulate the alignment problem as an optimization procedure on this non-linear space by exploiting its intrinsic geometry. We focus our attention on semantically meaningful videos or signals, e.g., those describing or capturing human motion or activities, and propose a new formalism for temporal alignment accounting for executing rate variations among realizations of the same video event. By construction, we address this static and deterministic alignment task in a dynamic and stochastic manner: we regard the search for optimal alignment parameters as a recursive state estimation problem for a particular dynamic system evolving on the alignment manifold. Consequently, a Sequential Importance Sampling iteration on the alignment manifold is designed for effective and efficient alignment. We demonstrate the performance on several types...
Ruonan Li, Rama Chellappa
Added 10 Feb 2011
Updated 10 Feb 2011
Type Journal
Year 2010
Where ECCV
Authors Ruonan Li, Rama Chellappa
Comments (0)