155 search results - page 3 / 31 » On the effectiveness of evaluating retrieval systems in the ... |
SIGIR
2008
ACM
13 years 5 months ago
2008
ACM
This paper investigates the agreement of relevance assessments between official TREC judgments and those generated from an interactive IR experiment. Results show that 63% of docu...
SIGIR
2010
ACM
13 years 9 months ago
2010
ACM
Evaluation metrics play a critical role both in the context of comparative evaluation of the performance of retrieval systems and in the context of learning-to-rank (LTR) as objec...
SIGIR
2004
ACM
13 years 10 months ago
2004
ACM
This paper examines whether the Cranfield evaluation methodology is robust to gross violations of the completeness assumption (i.e., the assumption that all relevant documents wi...
CIKM
2007
Springer
13 years 11 months ago
2007
Springer
Taking advantage of the well-known cluster hypothesis that “closely associated documents tend to be relevant to the same request”, we can use inter-document similarity to prov...
CIKM
2003
Springer
13 years 10 months ago
2003
Springer
Keeping track of changes in user interests from a document stream with a few relevance judgments is not an easy task. To tackle this problem, we propose a novel method that integr...