ACL
2009
13 years 2 months ago
2009
A number of approaches to Automatic MT Evaluation based on deep linguistic knowledge have been suggested. However, n-gram based metrics are still today the dominant approach. The ...
EMNLP
2010
13 years 2 months ago
2010
Automatic evaluation of Machine Translation (MT) quality is essential to developing highquality MT systems. Various evaluation metrics have been proposed, and BLEU is now used as ...
ICCBR
2010
Springer
13 years 3 months ago
2010
Springer
The need for automated text evaluation is common to several AI disciplines. In this work, we explore the use of Machine Translation (MT) evaluation metrics for Textual Case Based R...
SIGIR
2008
ACM
13 years 4 months ago
2008
ACM
Information retrieval systems are compared using evaluation metrics, with researchers commonly reporting results for simple metrics such as precision-at-10 or reciprocal rank toge...
FLAIRS
2006
13 years 6 months ago
2006
In this paper, we propose a novel framework for extractive summarization. Our framework allows the summarizer to adapt and improve itself. Experimental results show that our summa...
LREC
2008
2008
All, and only, the Errors: more Complete and Consistent Spelling and OCR-Error Correction Evaluation
13 years 6 months ago
Some time in the future, some spelling error correction system will correct all the errors, and only the errors. We need evaluation metrics that will tell us when this has been ac...
LREC
2010
13 years 6 months ago
2010
We describe a dataset containing 16,000 translations produced by four machine translation systems and manually annotated for quality by professional translators. This dataset can ...
ACL
2007
13 years 6 months ago
2007
Many automatic evaluation metrics for machine translation (MT) rely on making comparisons to human translations, a resource that may not always be available. We present a method f...
ACL
2008
13 years 6 months ago
2008
We propose an automatic machine translation (MT) evaluation metric that calculates a similarity score (based on precision and recall) of a pair of sentences. Unlike most metrics, ...
CICLING
2005
Springer
13 years 6 months ago
2005
Springer
Recent years have seen increasing interest in automatic metrics for the evaluation of generation systems. When a system can generate syntactic variation, automatic evaluation becom...