A Hierarchical Visual Model for Video Object Summarization

8 years 9 months ago
A Hierarchical Visual Model for Video Object Summarization
We propose a novel method for removing irrelevant frames from a video given user-provided frame-level labeling for a very small number of frames. We first hypothesize a number of windows which possibly contain the object of interest, and then determine which window(s) truly contain the object of interest. Our method enjoys several favorable properties. First, compared to approaches where a single descriptor is used to describe a whole frame, each window's feature descriptor has the chance of genuinely describing the object of interest; hence it is less affected by background clutter. Second, by considering the temporal continuity of a video instead of treating frames as independent, we can hypothesize the location of the windows more accurately. Third, by infusing prior knowledge into the patch-level model, we can precisely follow the trajectory of the object of interest. This allows us to largely reduce the number of windows and hence reduce the chance of overfitting the data dur...
David Liu, Gang Hua, Tsuhan Chen
Added 20 May 2011
Updated 20 May 2011
Type Journal
Year 2010
Where PAMI
Authors David Liu, Gang Hua, Tsuhan Chen
Comments (0)