Sciweavers

NAACL
2010
13 years 2 months ago
The Best Lexical Metric for Phrase-Based Statistical MT System Optimization
Translation systems are generally trained to optimize BLEU, but many alternative metrics are available. We explore how optimizing toward various automatic evaluation metrics (BLEU...
Daniel Cer, Christopher D. Manning, Daniel Jurafsk...
MT
2010
88views more  MT 2010»
13 years 3 months ago
Metric and reference factors in minimum error rate training
In Minimum Error Rate Training (MERT), BLEU is often used as the error function, despite the fact that it has been shown to have a lower correlation with human judgment than other...
Yifan He, Andy Way
EMNLP
2008
13 years 6 months ago
Decomposability of Translation Metrics for Improved Evaluation and Efficient Algorithms
BLEU is the de facto standard for evaluation and development of statistical machine translation systems. We describe three real-world situations involving comparisons between diff...
David Chiang, Steve DeNeefe, Yee Seng Chan, Hwee T...
EMNLP
2008
13 years 6 months ago
Complexity of Finding the BLEU-optimal Hypothesis in a Confusion Network
Confusion networks are a simple representation of multiple speech recognition or translation hypotheses in a machine translation system. A typical operation on a confusion network...
Gregor Leusch, Evgeny Matusov, Hermann Ney