Sciweavers

CIVR
2007
Springer

A reranking approach for context-based concept fusion in video indexing and retrieval

14 years 6 months ago
A reranking approach for context-based concept fusion in video indexing and retrieval
We propose to incorporate hundreds of pre-trained concept detectors to provide contextual information for improving the performance of multimodal video search. The approach takes initial search results from established video search methods (which typically are conservative in usage of concept detectors) and mines these results to discover and leverage co-occurrence patterns with detection results for hundreds of other concepts, thereby refining and reranking the initial video search result. We test the method on TRECVID 2005 and 2006 automatic video search tasks and find improvements in mean average precision (MAP) of 15%-30%. We also find that the method is adept at discovering contextual relationships that are unique to news stories occurring in the search set, which would be difficult or impossible to discover even if external training data were available. Categories and Subject Descriptors H.3.1 [Information Search and Retrieval]: Content Analysis and Indexing General Terms Alg...
Lyndon S. Kennedy, Shih-Fu Chang
Added 07 Jun 2010
Updated 07 Jun 2010
Type Conference
Year 2007
Where CIVR
Authors Lyndon S. Kennedy, Shih-Fu Chang
Comments (0)