Sciweavers

73 search results - page 1 / 15
» Topic (query) selection for IR evaluation
Sort
View
SIGIR
2009
ACM
13 years 11 months ago
Topic (query) selection for IR evaluation
The need for evaluating large amounts of topics (queries) makes IR evaluation an uneasy task. In this paper, we study a topic selection problem for IR evaluation. The selection cr...
Jianhan Zhu, Jun Wang, Vishwa Vinay, Ingemar J. Co...
SIGIR
2012
ACM
11 years 7 months ago
An uncertainty-aware query selection model for evaluation of IR systems
We propose a mathematical framework for query selection as a mechanism for reducing the cost of constructing information retrieval test collections. In particular, our mathematica...
Mehdi Hosseini, Ingemar J. Cox, Natasa Milic-Frayl...
ECIR
2008
Springer
13 years 6 months ago
Discounted Cumulated Gain Based Evaluation of Multiple-Query IR Sessions
IR research has a strong tradition of laboratory evaluation of systems. Such research is based on test collections, pre-defined test topics, and standard evaluation metrics. While ...
Kalervo Järvelin, Susan L. Price, Lois M. L. ...
IR
2006
13 years 4 months ago
A decision mechanism for the selective combination of evidence in topic distillation
The combination of evidence can increase retrieval effectiveness. In this paper, we investigate the effectiveness of a decision mechanism for the selective combination of evidence...
Vassilis Plachouras, Fidel Cacheda, Iadh Ounis
IR
2000
13 years 4 months ago
A Task-Oriented Non-Interactive Evaluation Methodology for Information Retrieval Systems
Past research has identified many different types of relevance in information retrieval (IR). So far, however, most evaluation of IR systems has been through batch experiments cond...
Jane Reid