Sciweavers

735 search results - page 25 / 147
» TREC: Experiment and evaluation in information retrieval
Sort
View
LREC
2010
143views Education» more  LREC 2010»
15 years 2 months ago
Evaluation of Document Citations in Phase 2 Gale Distillation
The focus of information retrieval evaluations, such as NIST's TREC evaluations (e.g. Voorhees 2003), is on evaluation of the information content of system responses. On the ...
Olga Babko-Malaya, Dan Hunter, Connie Fournelle, J...
WSDM
2010
ACM
173views Data Mining» more  WSDM 2010»
15 years 10 months ago
Measuring the Reusability of Test Collections
While test collection construction is a time-consuming and expensive process, the true cost is amortized by reusing the collection over hundreds or thousands of experiments. Some ...
Ben Carterette, Evgeniy Gabrilovich, Vanja Josifov...
NAACL
2004
15 years 2 months ago
Answering Definition Questions Using Multiple Knowledge Sources
Definition questions represent a largely unexplored area of question answering--they are different from factoid questions in that the goal is to return as many relevant "nugg...
Wesley Hildebrandt, Boris Katz, Jimmy J. Lin
IPM
2000
96views more  IPM 2000»
15 years 1 months ago
Further reflections on TREC
The paper reviews the TREC Programme up to TREC-6 (1997), considering the test results, the substantive findings for IR that follow, and the lessons TREC offers for IR evaluation....
Karen Sparck Jones
SIGIR
2003
ACM
15 years 6 months ago
The TREC-like evaluation of music IR systems
This poster reports upon the ongoing efforts being made to establish TREC-like and other comprehensive evaluation paradigms within the Music IR (MIR) and Music Digital Library (MD...
J. Stephen Downie