Sciweavers

4272 search results - page 14 / 855
» A Case for Automatic System Evaluation
Sort
View
CICLING
2005
Springer
14 years 11 months ago
Evaluating Evaluation Methods for Generation in the Presence of Variation
Recent years have seen increasing interest in automatic metrics for the evaluation of generation systems. When a system can generate syntactic variation, automatic evaluation becom...
Amanda Stent, Matthew Marge, Mohit Singhai
LREC
2008
99views Education» more  LREC 2008»
14 years 11 months ago
Evaluating and Extending the Coverage of HPSG Grammars: A Case Study for German
In this work, we examine and attempt to extend the coverage of a German HPSG grammar. We use the grammar to parse a corpus of newspaper text and evaluate the proportion of sentenc...
Jeremy Nicholson, Valia Kordoni, Yi Zhang 0003, Ti...
ICSE
2004
IEEE-ACM
15 years 9 months ago
Automated Generation of Test Programs from Closed Specifications of Classes and Test Cases
Most research on automated specification-based software testing has focused on the automated generation of test cases. Before a software system can be tested, it must be set up ac...
Wee Kheng Leow, Siau-Cheng Khoo, Yi Sun
COLING
2002
14 years 9 months ago
Automatic Linguistic Analysis for Language Teachers: The Case of Zeros
This paper presents the Natural Language Processing-based linguistic analysis tool that we have developed for Japanese as a Second Language teachers. This program, Zero Detector (...
Mitsuko Yamura-Takei, Miho Fujiwara, Makoto Yoshie...
IPM
2007
99views more  IPM 2007»
14 years 9 months ago
Older versions of the ROUGEeval summarization evaluation system were easier to fool
We show some limitations of the ROUGE evaluation method for automatic summarization. We present a method for automatic summarization based on a Markov model of the source text. By...
Jonas Sjöbergh