Sciweavers

Share
NAACL
2003

Automatic Evaluation of Summaries Using N-gram Co-occurrence Statistics

8 years 10 months ago
Automatic Evaluation of Summaries Using N-gram Co-occurrence Statistics
Following the recent adoption by the machine translation community of automatic evaluation using the BLEU/NIST scoring process, we conduct an in-depth study of a similar idea for evaluating summaries. The results show that automatic evaluation using unigram cooccurrences between summary pairs correlates surprising well with human evaluations, based on various statistical metrics; while direct application of the BLEU evaluation procedure does not always give good results.
Chin-Yew Lin, Eduard H. Hovy
Added 31 Oct 2010
Updated 31 Oct 2010
Type Conference
Year 2003
Where NAACL
Authors Chin-Yew Lin, Eduard H. Hovy
Comments (0)
books