Evaluation in the context of natural language generation

What role should evaluation play in the development of natural language generation () techniques and systems? In this paper we describe what is involved in natural language generation, and survey how evaluation has figured in work in this area to date. We comment on the issues raised by this existing work and on how the problems of  evaluation are different from the problems of evaluating work in natural language understanding. The paper is concluded by suggesting a way forward by looking more closely at the component problems that are addressed in natural language generation research; a particular text generation application is examined and the issues that are raised in assessing its performance on a variety of dimensions are looked at. © 1998 Academic Press

• Type: Journal
• Year: 1998
• Where: CSL
• Authors: Chris Mellish, R. Dale
• Keywords: Automated Reasoning, CSL 1998, Evaluation, Natural Language Generation, Problems