Automatic Evaluation of Computer Generated Text: A Progress Report on the TEXTEVAL Project

We present results ofexperiments designed to assess the usefulness of a new technique for the evaluation of translation quality, comparing human rankings with automatic measures. The basis ofour approach is the use ofa standard set and the adoption of a statistical viewof translation quality. This approach has the ability to provide evaluations which avoid dependence on any particular theory of translation, which are therefore potentially more objectivethan previous techniques. The work presented here was supported by the Science and Engineering and the Social and Economic Research Councils of Great Britain, and would not have been possiblewithout the gracious assistance of Ian Mason of Heriot Watt University, Edinburgh.

• Type: Conference
• Year: 1994
• Where: NAACL
• Authors: Chris Brew, Henry S. Thompson
• Keywords: Basis Ofour Approach, NAACL 1994, NAACL 2007, Translation Quality, Viewof Translation Quality