330 search results - page 1 / 66 » A statistical method for system evaluation using incomplete ... |
SIGIR
2006
ACM
13 years 10 months ago
2006
ACM
We consider the problem of large-scale retrieval evaluation, and we propose a statistical method for evaluating retrieval systems using incomplete judgments. Unlike existing techn...
CIKM
2007
Springer
13 years 8 months ago
2007
Springer
Information retrieval experimentation generally proceeds in a cycle of development, evaluation, and hypothesis testing. Ideally, the evaluation and testing phases should be short ...
SIGIR
2010
ACM
13 years 4 months ago
2010
ACM
In information retrieval (IR), research aiming to reduce the cost of retrieval system evaluations has been conducted along two lines: (i) the evaluation of IR systems with reduced...
CIKM
2006
Springer
13 years 8 months ago
2006
Springer
We consider the problem of evaluating retrieval systems using incomplete judgment information. Buckley and Voorhees recently demonstrated that retrieval systems can be efficiently...
SIGIR
2004
ACM
13 years 10 months ago
2004
ACM
This paper examines whether the Cranfield evaluation methodology is robust to gross violations of the completeness assumption (i.e., the assumption that all relevant documents wi...