Sciweavers

Share
MM
2005
ACM

Automatic discovery of query-class-dependent models for multimodal search

11 years 7 months ago
Automatic discovery of query-class-dependent models for multimodal search
We develop a framework for the automatic discovery of query classes for query-class-dependent search models in multimodal retrieval. The framework automatically discovers useful query classes by clustering queries in a training set according to the performance of various unimodal search methods, yielding classes of queries which have similar fusion strategies for the combination of unimodal components for multimodal search. We further combine these performance features with the semantic features of the queries during clustering in order to make discovered classes meaningful. The inclusion of the semantic space also makes it possible to choose the correct class for new, unseen queries, which have unknown performance space features. We evaluate the system against the TRECVID 2004 automatic video search task and find that the automatically discovered query classes give an improvement of 18% in MAP over hand-defined query classes used in previous works. We also find that some hand-de...
Lyndon S. Kennedy, Apostol Natsev, Shih-Fu Chang
Added 26 Jun 2010
Updated 26 Jun 2010
Type Conference
Year 2005
Where MM
Authors Lyndon S. Kennedy, Apostol Natsev, Shih-Fu Chang
Comments (0)
books