Sciweavers

330 search results - page 2 / 66
» A statistical method for system evaluation using incomplete ...
Sort
View
ICDIM
2007
IEEE
13 years 11 months ago
Several methods of ranking retrieval systems with partial relevance judgment
: Some measures such as average precision over all relevant documents and recall level precision are considered as good system-oriented measures, because they concern both precisio...
Shengli Wu, Sally I. McClean
SIGIR
2003
ACM
13 years 10 months ago
On the effectiveness of evaluating retrieval systems in the absence of relevance judgments
Soboroff, Nicholas and Cahan recently proposed a method for evaluating the performance of retrieval systems without relevance judgments. They demonstrated that the system evaluat...
Javed A. Aslam, Robert Savell
ECIR
2008
Springer
13 years 6 months ago
Here or There
Abstract. Information retrieval systems have traditionally been evaluated over absolute judgments of relevance: each document is judged for relevance on its own, independent of oth...
Ben Carterette, Paul N. Bennett, David Maxwell Chi...
SIGIR
2008
ACM
13 years 4 months ago
A simple and efficient sampling method for estimating AP and NDCG
We consider the problem of large scale retrieval evaluation. Recently two methods based on random sampling were proposed as a solution to the extensive effort required to judge te...
Emine Yilmaz, Evangelos Kanoulas, Javed A. Aslam
CIKM
2007
Springer
13 years 11 months ago
Semiautomatic evaluation of retrieval systems using document similarities
Taking advantage of the well-known cluster hypothesis that “closely associated documents tend to be relevant to the same request”, we can use inter-document similarity to prov...
Ben Carterette, James Allan