Sciweavers

Share
ACL
2012
7 years 22 days ago
Assessing the Effect of Inconsistent Assessors on Summarization Evaluation
We investigate the consistency of human assessors involved in summarization evaluation to understand its effect on system ranking and automatic evaluation techniques. Using Text A...
Karolina Owczarzak, Peter A. Rankel, Hoa Trang Dan...
ACL
2012
7 years 22 days ago
Joint Learning of a Dual SMT System for Paraphrase Generation
SMT has been used in paraphrase generation by translating a source sentence into another (pivot) language and then back into the source. The resulting sentences can be used as can...
Hong Sun, Ming Zhou
DLOG
2011
8 years 1 months ago
Reasoning-Supported Interactive Revision of Knowledge Bases
We propose a method for controlling the quality of (semi-)automatically acquired axioms. We combine the manual inspection of axioms with automatic evaluation decisions and propose ...
Nadeschda Nikitina, Sebastian Rudolph, Birte Glimm
EMNLP
2010
8 years 8 months ago
Automatic Evaluation of Translation Quality for Distant Language Pairs
Automatic evaluation of Machine Translation (MT) quality is essential to developing highquality MT systems. Various evaluation metrics have been proposed, and BLEU is now used as ...
Hideki Isozaki, Tsutomu Hirao, Kevin Duh, Katsuhit...
ACL
2010
8 years 8 months ago
Automatic Evaluation Method for Machine Translation Using Noun-Phrase Chunking
As described in this paper, we propose a new automatic evaluation method for machine translation using noun-phrase chunking. Our method correctly determines the matching words bet...
Hiroshi Echizen-ya, Kenji Araki
IIE
2006
84views more  IIE 2006»
8 years 10 months ago
On the Suitability of Programming Tasks for Automated Evaluation
Abstract. For many programming tasks we would be glad to have some kind of automatic evaluation process. As an example, most of the programming contests use an automatic evaluation...
Michal Forisek
NAACL
2003
8 years 11 months ago
Automatic Evaluation of Summaries Using N-gram Co-occurrence Statistics
Following the recent adoption by the machine translation community of automatic evaluation using the BLEU/NIST scoring process, we conduct an in-depth study of a similar idea for ...
Chin-Yew Lin, Eduard H. Hovy
ACL
2003
8 years 11 months ago
Feedback Cleaning of Machine Translation Rules Using Automatic Evaluation
When rules of transfer-based machine translation (MT) are automatically acquired from bilingual corpora, incorrect/redundant rules are generated due to acquisition errors or trans...
Kenji Imamura, Eiichiro Sumita, Yuji Matsumoto
ACL
2006
8 years 11 months ago
Models for Sentence Compression: A Comparison across Domains, Training Requirements and Evaluation Measures
Sentence compression is the task of producing a summary at the sentence level. This paper focuses on three aspects of this task which have not received detailed treatment in the l...
James Clarke, Mirella Lapata
LREC
2010
148views Education» more  LREC 2010»
8 years 11 months ago
Mining the Correlation between Human and Automatic Evaluation at Sentence Level
Automatic evaluation metrics are fast and cost-effective measurements of the quality of a Machine Translation (MT) system. However, as humans are the end-user of MT output, human ...
Yanli Sun
books