ParaMetric: An Automatic Evaluation Metric for Paraphrasing

We present ParaMetric, an automatic evaluation metric for data-driven approaches to paraphrasing. ParaMetric provides an objective measure of quality using a collection of multiple translations whose paraphrases have been manually annotated. ParaMetric calculates precision and recall scores by comparing the paraphrases discovered by automatic paraphrasing techniques against gold standard alignments of words and phrases within equivalent sentences. We report scores for several established paraphrasing techniques.

• Type: Conference
• Year: 2008
• Where: COLING
• Authors: Chris Callison-Burch, Trevor Cohn, Mirella Lapata
• Keywords: Automatic Paraphrasing Techniques, COLING 2008, Computational Linguistics, ParaMetric Calculates Precision, Paraphrasing Techniques