Sciweavers

Share
ICIP
2008
IEEE

Movie summarization based on audiovisual saliency detection

9 years 4 months ago
Movie summarization based on audiovisual saliency detection
Based on perceptual and computational attention modeling studies, we formulate measures of saliency for an audiovisual stream. Audio saliency is captured by signal modulations and related multifrequency band features, extracted through nonlinear operators and energy tracking. Visual saliency is measured by means of a spatiotemporal attention model driven by various feature cues (intensity, color, motion). Audio and video curves are integrated in a single attention curve, where events may be enhanced, suppressed or vanished. The presence of salient events is signified on this audiovisual curve by geometrical features such as local extrema, sharp transition points and level sets. An audiovisual saliency-based movie summarization algorithm is proposed and evaluated. The algorithm is shown to perform very well in terms of summary informativeness and enjoyability for movie clips of various genres.
Georgios Evangelopoulos, Konstantinos Rapantzikos,
Added 20 Oct 2009
Updated 20 Oct 2009
Type Conference
Year 2008
Where ICIP
Authors Georgios Evangelopoulos, Konstantinos Rapantzikos, Alexandros Potamianos, Petros Maragos, Nancy Zlatintsi, Yannis S. Avrithis
Comments (0)
books