Sciweavers

155 search results - page 2 / 31
» On the effectiveness of evaluating retrieval systems in the ...
Sort
View
SIGIR
2006
ACM
13 years 10 months ago
A statistical method for system evaluation using incomplete judgments
We consider the problem of large-scale retrieval evaluation, and we propose a statistical method for evaluating retrieval systems using incomplete judgments. Unlike existing techn...
Javed A. Aslam, Virgiliu Pavlu, Emine Yilmaz
SIGIR
2010
ACM
13 years 4 months ago
Retrieval system evaluation: automatic evaluation versus incomplete judgments
In information retrieval (IR), research aiming to reduce the cost of retrieval system evaluations has been conducted along two lines: (i) the evaluation of IR systems with reduced...
Claudia Hauff, Franciska de Jong
JASIS
2010
124views more  JASIS 2010»
13 years 3 months ago
Query polyrepresentation for ranking retrieval systems without relevance judgments
Ranking information retrieval (IR) systems with respect to their effectiveness is a crucial operation during IR evaluation, as well as during data fusion. This paper offers a no...
Miles Efron, Megan A. Winget
SIGIR
2003
ACM
13 years 10 months ago
Automatic ranking of retrieval systems in imperfect environments
The empirical investigation of the effectiveness of information retrieval (IR) systems requires a test collection, a set of query topics, and a set of relevance judgments made by ...
Rabia Nuray, Fazli Can
SIGIR
2012
ACM
11 years 7 months ago
An uncertainty-aware query selection model for evaluation of IR systems
We propose a mathematical framework for query selection as a mechanism for reducing the cost of constructing information retrieval test collections. In particular, our mathematica...
Mehdi Hosseini, Ingemar J. Cox, Natasa Milic-Frayl...