Sciweavers

Share
PAMI
2006

The Semantic Pathfinder: Using an Authoring Metaphor for Generic Multimedia Indexing

8 years 11 months ago
The Semantic Pathfinder: Using an Authoring Metaphor for Generic Multimedia Indexing
This paper presents the semantic pathfinder architecture for generic indexing of multimedia archives. The semantic pathfinder extracts semantic concepts from video by exploring different paths through three consecutive analysis steps, which we derive from the observation that produced video is the result of an authoring-driven process. We exploit this authoring metaphor for machine-driven understanding. The pathfinder starts with the content analysis step. In this analysis step, we follow a data-driven approach of indexing semantics. The style analysis step is the second analysis step. Here, we tackle the indexing problem by viewing a video from the perspective of production. Finally, in the context analysis step, we view semantics in context. The virtue of the semantic pathfinder is its ability to learn the best path of analysis steps on a per-concept basis. To show the generality of this novel indexing approach, we develop detectors for a lexicon of 32 concepts and we evaluate the se...
Cees Snoek, Marcel Worring, Jan-Mark Geusebroek, D
Added 14 Dec 2010
Updated 14 Dec 2010
Type Journal
Year 2006
Where PAMI
Authors Cees Snoek, Marcel Worring, Jan-Mark Geusebroek, Dennis Koelma, Frank J. Seinstra, Arnold W. M. Smeulders
Comments (0)
books