Sciweavers

4589 search results - page 2 / 918
» A new evaluation measure for information retrieval systems
Sort
View
SIGIR
2006
ACM
13 years 11 months ago
One-sided measures for evaluating ranked retrieval effectiveness with spontaneous conversational speech
Early speech retrieval experiments focused on news broadcasts, for which adequate Automatic Speech Recognition (ASR) accuracy could be obtained. Like newspapers, news broadcasts a...
Baolong Liu, Douglas W. Oard
SIGIR
2004
ACM
13 years 10 months ago
Retrieval evaluation with incomplete information
This paper examines whether the Cranfield evaluation methodology is robust to gross violations of the completeness assumption (i.e., the assumption that all relevant documents wi...
Chris Buckley, Ellen M. Voorhees
IIR
2010
13 years 6 months ago
A Study on Evaluation on Opinion Retrieval Systems
We study the evaluation of opinion retrieval systems. Opinion retrieval is a relatively new research area, nevertheless classical evaluation measures, those adopted for ad hoc ret...
Giambattista Amati, Giuseppe Amodeo, Valerio Capoz...
AAAI
2007
13 years 7 months ago
Topic Segmentation Algorithms for Text Summarization and Passage Retrieval: An Exhaustive Evaluation
In order to solve problems of reliability of systems based on lexical repetition and problems of adaptability of languagedependent systems, we present a context-based topic segmen...
Gaël Dias, Elsa Alves, José Gabriel Pe...
CIKM
2009
Springer
13 years 11 months ago
Evaluation of methods for relative comparison of retrieval systems based on clickthroughs
The Cranfield evaluation method has some disadvantages, including its high cost in labor and inadequacy for evaluating interactive retrieval techniques. As a very promising alter...
Jing He, Chengxiang Zhai, Xiaoming Li