Video search reranking via information bottleneck principle

We propose a novel and generic video/image reranking algorithm, IB reranking, which reorders results from text-only searches by discovering the salient visual patterns of relevant and irrelevant shots from the approximate relevance provided by text results. The IB reranking method, based on a rigorous Information Bottleneck (IB) principle, finds the optimal clustering of images that preserves the maximal mutual information between the search relevance and the high-dimensional low-level visual features of the images in the text search results. Evaluating the approach on the TRECVID 2003-2005 data sets shows significant improvement upon the text search baseline, with relative increases in average performance of up to 23%. The method requires no image search examples from the user, but is competitive with other state-of-the-art example-based approaches. The method is also highly generic and performs comparably with sophisticated models which are highly tuned for specific classes of qu...

• Type: Conference
• Year: 2006
• Where: MM
• Authors: Winston H. Hsu, Lyndon S. Kennedy, Shih-Fu Chang
• Keywords: IB Reranking Method, MM 2006, Reranking Method, Video/image Reranking Algorithm