5 search results - page 1 / 1 » Hypothesis testing with incomplete relevance judgments |
CIKM
2007
Springer
13 years 8 months ago
2007
Springer
Information retrieval experimentation generally proceeds in a cycle of development, evaluation, and hypothesis testing. Ideally, the evaluation and testing phases should be short ...
SIGIR
2004
ACM
13 years 10 months ago
2004
ACM
This paper examines whether the Cranfield evaluation methodology is robust to gross violations of the completeness assumption (i.e., the assumption that all relevant documents wi...
SIGIR
2006
ACM
13 years 10 months ago
2006
ACM
We consider the problem of large-scale retrieval evaluation, and we propose a statistical method for evaluating retrieval systems using incomplete judgments. Unlike existing techn...
WWW
2005
ACM
14 years 5 months ago
2005
ACM
We describe a framework of bootstrapped hypothesis testing for estimating the confidence in one web search engine outperforming another over any randomly sampled query set of a gi...
ECIR
2010
Springer
13 years 6 months ago
2010
Springer
Ranking a set retrieval systems according to their retrieval effectiveness without relying on relevance judgments was first explored by Soboroff et al. [13]. Over the years, a numb...