Sciweavers

Share
IPM
2007

Using query logs to establish vocabularies in distributed information retrieval

8 years 12 months ago
Using query logs to establish vocabularies in distributed information retrieval
Users of search engines express their needs as queries, typically consisting of a small number of terms. The resulting search engine query logs are valuable resources that can be used to predict how people interact with the search system. In this paper, we introduce two novel applications of query logs, in the context of distributed information retrieval. First, we use query log terms to guide sampling from uncooperative distributed collections. We show that while our sampling strategy is at least as efficient as current methods, it consistently performs better. Second, we propose and evaluate a pruning strategy that uses query log information to eliminate terms. Our experiments show that our proposed pruning method maintains the accuracy achieved by complete indexes, while decreasing the index size by up to 60%. While such pruning may not always be desirable in practice, it provides a useful benchmark against which other pruning strategies can be measured. Ó 2006 Elsevier Ltd. All r...
Milad Shokouhi, Justin Zobel, Seyed M. M. Tahaghog
Added 15 Dec 2010
Updated 15 Dec 2010
Type Journal
Year 2007
Where IPM
Authors Milad Shokouhi, Justin Zobel, Seyed M. M. Tahaghoghi, Falk Scholer
Comments (0)
books