Sciweavers

38 search results - page 1 / 8
» Ranking Human and Machine Summarization Systems
Sort
View
EMNLP
2011
12 years 4 months ago
Ranking Human and Machine Summarization Systems
Peter Rankel, John M. Conroy, Eric Slud, Dianne P....
COLING
2010
12 years 12 months ago
Multilingual Summarization Evaluation without Human Models
We study correlation of rankings of text summarization systems using evaluation methods with and without human models. We apply our comparison framework to various well-establishe...
Horacio Saggion, Juan Manuel Torres Moreno, Iria d...
ACL
2012
11 years 7 months ago
Assessing the Effect of Inconsistent Assessors on Summarization Evaluation
We investigate the consistency of human assessors involved in summarization evaluation to understand its effect on system ranking and automatic evaluation techniques. Using Text A...
Karolina Owczarzak, Peter A. Rankel, Hoa Trang Dan...
EMNLP
2009
13 years 2 months ago
Automatically Evaluating Content Selection in Summarization without Human Models
We present a fully automatic method for content selection evaluation in summarization that does not require the creation of human model summaries. Our work capitalizes on the assu...
Annie Louis, Ani Nenkova
IPM
2007
131views more  IPM 2007»
13 years 4 months ago
Beyond SumBasic: Task-focused summarization with sentence simplification and lexical expansion
In recent years, there has been increased interest in topic-focused multi-document summarization. In this task, automatic summaries are produced in response to a specific informat...
Lucy Vanderwende, Hisami Suzuki, Chris Brockett, A...