Sciweavers

2269 search results - page 1 / 454
» Retrieval evaluation with incomplete information
Sort
View
SIGIR
2004
ACM
13 years 9 months ago
Retrieval evaluation with incomplete information
This paper examines whether the Cranfield evaluation methodology is robust to gross violations of the completeness assumption (i.e., the assumption that all relevant documents wi...
Chris Buckley, Ellen M. Voorhees
SIGIR
2010
ACM
13 years 4 months ago
Retrieval system evaluation: automatic evaluation versus incomplete judgments
In information retrieval (IR), research aiming to reduce the cost of retrieval system evaluations has been conducted along two lines: (i) the evaluation of IR systems with reduced...
Claudia Hauff, Franciska de Jong
IPM
2008
114views more  IPM 2008»
13 years 4 months ago
Evaluating epistemic uncertainty under incomplete assessments
The thesis of this study is to propose an extended methodology for laboratory based Information Retrieval evaluation under incomplete relevance assessments. This new methodology a...
Mark Baillie, Leif Azzopardi, Ian Ruthven
ECIR
2007
Springer
13 years 5 months ago
A Retrieval Evaluation Methodology for Incomplete Relevance Assessments
In this paper we a propose an extended methodology for laboratory based Information Retrieval evaluation under incomplete relevance assessments. This new protocol aims to identify ...
Mark Baillie, Leif Azzopardi, Ian Ruthven
CLEF
2010
Springer
13 years 1 months ago
Examining the Robustness of Evaluation Metrics for Patent Retrieval with Incomplete Relevance Judgements
Recent years have seen a growing interest in research into patent retrieval. One of the key issues in conducting information retrieval (IR) research is meaningful evaluation of the...
Walid Magdy, Gareth J. F. Jones