A Dataset for Assessing Machine Translation Evaluation Metrics

We describe a dataset containing 16,000 translations produced by four machine translation systems and manually annotated for quality by professional translators. This dataset can be used in a range of tasks assessing machine translation evaluation metrics, from basic correlation analysis to training and test of machine learning-based metrics. By providing a standard dataset for such tasks, we hope to encourage the development of better MT evaluation metrics.

• Type: Conference
• Year: 2010
• Where: LREC
• Authors: Lucia Specia, Nicola Cancedda, Marc Dymetman
• Keywords: Education, Evaluation Metrics, LREC 2010, Machine Translation, Translation Evaluation Metrics