Sciweavers

Share
ICASSP
2008
IEEE

Visual-aural attention modeling for talk show video highlight detection

10 years 7 months ago
Visual-aural attention modeling for talk show video highlight detection
In this paper, we propose a visual-aural attention modeling based video content analysis approach, which can be used to automatically detect the highlights of the popular TV program—talk show video. First, the visual and aural affective features are extracted to represent and model the human attention of highlight. For efficiency consideration, the adopted affective features are kept as few as possible. Then, a specific fusion strategy called ordinaldecision is used to combine the visual, aural attention models and form the attention curve for a video. This curve can reflect the change of human attention while watching TV. Finally, highlight segments are located at the peaks of the attention curve. Moreover, sentence boundary detection is used to refine the highlight boundaries in order to keep the segments’ integrality and fluency. This framework is extensible and flexible in integrating more affective features with a variety of fusion schemes. Experimental results demonstrate ou...
Yijia Zheng, Guangyu Zhu, Shuqiang Jiang, Qingming
Added 30 May 2010
Updated 30 May 2010
Type Conference
Year 2008
Where ICASSP
Authors Yijia Zheng, Guangyu Zhu, Shuqiang Jiang, Qingming Huang, Wen Gao
Comments (0)
books