Sciweavers

123 search results - page 1 / 25
» A Retrieval Evaluation Methodology for Incomplete Relevance ...
Sort
View
ECIR
2007
Springer
13 years 6 months ago
A Retrieval Evaluation Methodology for Incomplete Relevance Assessments
In this paper we a propose an extended methodology for laboratory based Information Retrieval evaluation under incomplete relevance assessments. This new protocol aims to identify ...
Mark Baillie, Leif Azzopardi, Ian Ruthven
IPM
2008
114views more  IPM 2008»
13 years 4 months ago
Evaluating epistemic uncertainty under incomplete assessments
The thesis of this study is to propose an extended methodology for laboratory based Information Retrieval evaluation under incomplete relevance assessments. This new methodology a...
Mark Baillie, Leif Azzopardi, Ian Ruthven
SIGIR
2010
ACM
13 years 5 months ago
Retrieval system evaluation: automatic evaluation versus incomplete judgments
In information retrieval (IR), research aiming to reduce the cost of retrieval system evaluations has been conducted along two lines: (i) the evaluation of IR systems with reduced...
Claudia Hauff, Franciska de Jong
CIKM
2004
Springer
13 years 10 months ago
Providing consistent and exhaustive relevance assessments for XML retrieval evaluation
Comparing retrieval approaches requires test collections, which consist of documents, queries and relevance assessments. Obtaining consistent and exhaustive relevance assessments ...
Benjamin Piwowarski, Mounia Lalmas
SIGIR
2004
ACM
13 years 10 months ago
Retrieval evaluation with incomplete information
This paper examines whether the Cranfield evaluation methodology is robust to gross violations of the completeness assumption (i.e., the assumption that all relevant documents wi...
Chris Buckley, Ellen M. Voorhees