Sciweavers

Share
ACL
1989

Evaluating Discourse Processing Algorithms

9 years 5 months ago
Evaluating Discourse Processing Algorithms
In order to take steps towards establishing a methodology for evaluating Natural Language systems, we conducted a case study. We attempt to evaluate two different approaches to anaphoric processing in discourse by comparing the accuracy and coverage of two published algorithms for finding the co-specifiers of pronouns in naturally occurring texts and dialogues. We present the quantitative results of handsimulating these algorithms, but this analysis naturally gives rise to both a qualitative evaluation and recommendations for performing such evaluations in general. We illustrate the general difficulties encountered with quantitative evaluation. These are problems with: (a) allowing for underlying assumptions, (b) determining how to handle underspecifications, and (c) evaluating the contribution of false positives and error chaining.
Marilyn A. Walker
Added 06 Nov 2010
Updated 06 Nov 2010
Type Conference
Year 1989
Where ACL
Authors Marilyn A. Walker
Comments (0)
books