5 search results - page 1 / 1 » Hypothesis testing with incomplete relevance judgments |
79
Voted
CIKM
2007
Springer
15 years 1 months ago
2007
Springer
Information retrieval experimentation generally proceeds in a cycle of development, evaluation, and hypothesis testing. Ideally, the evaluation and testing phases should be short ...
73
Voted
SIGIR
2004
ACM
15 years 2 months ago
2004
ACM
This paper examines whether the Cranfield evaluation methodology is robust to gross violations of the completeness assumption (i.e., the assumption that all relevant documents wi...
67
Voted
SIGIR
2006
ACM
15 years 3 months ago
2006
ACM
We consider the problem of large-scale retrieval evaluation, and we propose a statistical method for evaluating retrieval systems using incomplete judgments. Unlike existing techn...
64
Voted
WWW
2005
ACM
15 years 10 months ago
2005
ACM
We describe a framework of bootstrapped hypothesis testing for estimating the confidence in one web search engine outperforming another over any randomly sampled query set of a gi...
ECIR
2010
Springer
14 years 11 months ago
2010
Springer
Ranking a set retrieval systems according to their retrieval effectiveness without relying on relevance judgments was first explored by Soboroff et al. [13]. Over the years, a numb...