Sciweavers

155 search results - page 1 / 31
» On the effectiveness of evaluating retrieval systems in the ...
Sort
View
SIGIR
2003
ACM
13 years 9 months ago
On the effectiveness of evaluating retrieval systems in the absence of relevance judgments
Soboroff, Nicholas and Cahan recently proposed a method for evaluating the performance of retrieval systems without relevance judgments. They demonstrated that the system evaluat...
Javed A. Aslam, Robert Savell
ICDIM
2007
IEEE
13 years 10 months ago
Several methods of ranking retrieval systems with partial relevance judgment
: Some measures such as average precision over all relevant documents and recall level precision are considered as good system-oriented measures, because they concern both precisio...
Shengli Wu, Sally I. McClean
CIKM
2007
Springer
13 years 8 months ago
Hypothesis testing with incomplete relevance judgments
Information retrieval experimentation generally proceeds in a cycle of development, evaluation, and hypothesis testing. Ideally, the evaluation and testing phases should be short ...
Ben Carterette, Mark D. Smucker
CIKM
2006
Springer
13 years 8 months ago
Estimating average precision with incomplete and imperfect judgments
We consider the problem of evaluating retrieval systems using incomplete judgment information. Buckley and Voorhees recently demonstrated that retrieval systems can be efficiently...
Emine Yilmaz, Javed A. Aslam
JUCS
2008
117views more  JUCS 2008»
13 years 4 months ago
Ranking Retrieval Systems with Partial Relevance Judgements
: Some measures such as mean average precision and recall level precision are considered as good system-oriented measures, because they concern both precision and recall that are t...
Shengli Wu, Fabio Crestani