Sciweavers

181 search results - page 2 / 37
» Minimal test collections for retrieval evaluation
Sort
View
SIGIR
2000
ACM
13 years 9 months ago
Building a question answering test collection
The TREC-8 Question Answering (QA) Track was the first large-scale evaluation of domain-independent question answering systems. In addition to fostering research on the QA task, ...
Ellen M. Voorhees, Dawn M. Tice
WSDM
2010
ACM
173views Data Mining» more  WSDM 2010»
14 years 2 months ago
Measuring the Reusability of Test Collections
While test collection construction is a time-consuming and expensive process, the true cost is amortized by reusing the collection over hundreds or thousands of experiments. Some ...
Ben Carterette, Evgeniy Gabrilovich, Vanja Josifov...
LREC
2008
101views Education» more  LREC 2008»
13 years 6 months ago
Test Collections for Spoken Document Retrieval from Lecture Audio Data
The Spoken Document Processing Working Group, which is part of the special interest group of spoken language processing of the Information Processing Society of Japan, is developi...
Tomoyosi Akiba, Kiyoaki Aikawa, Yoshiaki Itoh, Tat...
SIGIR
2010
ACM
13 years 8 months ago
Reusable test collections through experimental design
Portable, reusable test collections are a vital part of research and development in information retrieval. Reusability is difficult to assess, however. The standard approach— si...
Ben Carterette, Evangelos Kanoulas, Virgiliu Pavlu...
JASIS
2006
120views more  JASIS 2006»
13 years 4 months ago
Building a reusable test collection for question answering
In contrast to traditional information retrieval systems, which return ranked lists of documents that users must manually browse through, a question answering system attempts to d...
Jimmy J. Lin, Boris Katz