Sciweavers

2039 search results - page 13 / 408
» A Metric for the Evaluation of Imitation
Sort
View
CICLING
2005
Springer
14 years 11 months ago
Evaluating Evaluation Methods for Generation in the Presence of Variation
Recent years have seen increasing interest in automatic metrics for the evaluation of generation systems. When a system can generate syntactic variation, automatic evaluation becom...
Amanda Stent, Matthew Marge, Mohit Singhai
CSL
2006
Springer
14 years 9 months ago
Application-independent evaluation of speaker detection
We propose and motivate an alternative to the traditional error-based or cost-based evaluation metrics for the goodness of speaker detection performance. The metric that we propos...
Niko Brümmer, Johan A. du Preez
EMNLP
2010
14 years 7 months ago
Automatic Evaluation of Translation Quality for Distant Language Pairs
Automatic evaluation of Machine Translation (MT) quality is essential to developing highquality MT systems. Various evaluation metrics have been proposed, and BLEU is now used as ...
Hideki Isozaki, Tsutomu Hirao, Kevin Duh, Katsuhit...
TSE
1998
109views more  TSE 1998»
14 years 9 months ago
An Evaluation of the MOOD Set of Object-Oriented Software Metrics
—This paper describes the results of an investigation into a set of metrics for object-oriented design, called the MOOD metrics. The merits of each of the six MOOD metrics is dis...
Richard H. Carver, Steve Counsell, Reuben V. Nithi
ACL
2012
13 years 7 days ago
Assessing the Effect of Inconsistent Assessors on Summarization Evaluation
We investigate the consistency of human assessors involved in summarization evaluation to understand its effect on system ranking and automatic evaluation techniques. Using Text A...
Karolina Owczarzak, Peter A. Rankel, Hoa Trang Dan...