Sciweavers

70 search results - page 4 / 14
» The Significance of Recall in Automatic Metrics for MT Evalu...
Sort
View
COLING
2008
13 years 7 months ago
The Impact of Reference Quality on Automatic MT Evaluation
Language resource quality is crucial in NLP. Many of the resources used are derived from data created by human beings out of an NLP context, especially regarding MT and reference ...
Olivier Hamon, Djamel Mostefa
NAACL
2010
13 years 3 months ago
The Best Lexical Metric for Phrase-Based Statistical MT System Optimization
Translation systems are generally trained to optimize BLEU, but many alternative metrics are available. We explore how optimizing toward various automatic evaluation metrics (BLEU...
Daniel Cer, Christopher D. Manning, Daniel Jurafsk...
COLING
2008
13 years 7 months ago
ParaMetric: An Automatic Evaluation Metric for Paraphrasing
We present ParaMetric, an automatic evaluation metric for data-driven approaches to paraphrasing. ParaMetric provides an objective measure of quality using a collection of multipl...
Chris Callison-Burch, Trevor Cohn, Mirella Lapata
LREC
2010
148views Education» more  LREC 2010»
13 years 7 months ago
Mining the Correlation between Human and Automatic Evaluation at Sentence Level
Automatic evaluation metrics are fast and cost-effective measurements of the quality of a Machine Translation (MT) system. However, as humans are the end-user of MT output, human ...
Yanli Sun
LREC
2010
164views Education» more  LREC 2010»
13 years 7 months ago
Evaluating Machine Translation Utility via Semantic Role Labels
We present the methodology that underlies new metrics for semantic machine translation evaluation that we are developing. Unlike widely-used lexical and n-gram based MT evaluation...
Chi-kiu Lo, Dekai Wu