LREC
2008
13 years 6 months ago
2008
The consortium ECESS1 (European Center of Excellence for Speech Synthesis) has set up a framework for evaluation of software modules and tools relevant for speech synthesis. Till ...
LREC
2008
13 years 6 months ago
2008
This paper analyses some general issues about human language technology evaluation, focusing on economic aspects. It first provides a scientific rationale for the need to organize...
LREC
2010
13 years 6 months ago
2010
Question answering systems are complex systems using natural language processing. Some evaluation campaigns are organized to evaluate such systems in order to propose a classifica...
LREC
2010
13 years 6 months ago
2010
Question Answering (QA) technology aims at providing relevant answers to natural language questions. Most Question Answering research has focused on mining document collections co...
LREC
2010
13 years 6 months ago
2010
This paper aims at measuring the reliability of judges in MT evaluation. The scope is two evaluation campaigns from the CESTA project, during which human evaluations were carried ...
CLEF
2006
Springer
13 years 8 months ago
2006
Springer
Abstract. This paper examines the current way of keeping the data produced during the evaluation campaigns and highlights some shortenings of it. As a consequence, we propose a new...
ECIR
2009
Springer
14 years 2 months ago
2009
Springer
Evaluating complex system is a complex task. Evaluation campaigns are organized each year to test different systems on global results, but they do not evaluate the relevance of th...