Sciweavers

330 search results - page 2 / 66
» A statistical method for system evaluation using incomplete ...
Sort
View
ICDIM
2007
IEEE
15 years 5 months ago
Several methods of ranking retrieval systems with partial relevance judgment
: Some measures such as average precision over all relevant documents and recall level precision are considered as good system-oriented measures, because they concern both precisio...
Shengli Wu, Sally I. McClean
SIGIR
2003
ACM
15 years 4 months ago
On the effectiveness of evaluating retrieval systems in the absence of relevance judgments
Soboroff, Nicholas and Cahan recently proposed a method for evaluating the performance of retrieval systems without relevance judgments. They demonstrated that the system evaluat...
Javed A. Aslam, Robert Savell
ECIR
2008
Springer
15 years 1 months ago
Here or There
Abstract. Information retrieval systems have traditionally been evaluated over absolute judgments of relevance: each document is judged for relevance on its own, independent of oth...
Ben Carterette, Paul N. Bennett, David Maxwell Chi...
SIGIR
2008
ACM
14 years 11 months ago
A simple and efficient sampling method for estimating AP and NDCG
We consider the problem of large scale retrieval evaluation. Recently two methods based on random sampling were proposed as a solution to the extensive effort required to judge te...
Emine Yilmaz, Evangelos Kanoulas, Javed A. Aslam
CIKM
2007
Springer
15 years 5 months ago
Semiautomatic evaluation of retrieval systems using document similarities
Taking advantage of the well-known cluster hypothesis that “closely associated documents tend to be relevant to the same request”, we can use inter-document similarity to prov...
Ben Carterette, James Allan