Sciweavers

735 search results - page 21 / 147
» TREC: Experiment and evaluation in information retrieval
Sort
View
SIGIR
2008
ACM
15 years 1 months ago
Novelty and diversity in information retrieval evaluation
Evaluation measures act as objective functions to be optimized by information retrieval systems. Such objective functions must accurately reflect user requirements, particularly w...
Charles L. A. Clarke, Maheedhar Kolla, Gordon V. C...
CIKM
2007
Springer
15 years 5 months ago
A comparison of statistical significance tests for information retrieval evaluation
Information retrieval (IR) researchers commonly use three tests of statistical significance: the Student's paired t-test, the Wilcoxon signed rank test, and the sign test. Ot...
Mark D. Smucker, James Allan, Ben Carterette
SIGIR
2006
ACM
15 years 7 months ago
Statistical precision of information retrieval evaluation
We introduce and validate bootstrap techniques to compute confidence intervals that quantify the effect of test-collection variability on average precision (AP) and mean average...
Gordon V. Cormack, Thomas R. Lynam
TREC
2000
15 years 2 months ago
The LIMSI SDR System for TREC-9
In this paper we describe the LIMSI Spoken Document Retrieval system used in the TREC-9 evaluation. This system combines an adapted version of the LIMSI 1999 Hub-4E transcription ...
Jean-Luc Gauvain, Lori Lamel, Claude Barras, Gille...
SIGIR
2010
ACM
15 years 1 months ago
Retrieval system evaluation: automatic evaluation versus incomplete judgments
In information retrieval (IR), research aiming to reduce the cost of retrieval system evaluations has been conducted along two lines: (i) the evaluation of IR systems with reduced...
Claudia Hauff, Franciska de Jong