Evaluation Metrics For End-to-End Coreference Resolution Systems

Commonly used coreference resolution evaluation metrics can only be applied to key mentions, i.e. already annotated mentions. We here propose two variants of the B3 and CEAF coreference resolution evaluation algorithms which can be applied to coreference resolution systems dealing with system mentions, i.e. automatically determined mentions. Our experiments show that our variants lead to intuitive and reliable results.

• Type: Journal
• Year: 2010
• Where: SIGDIAL
• Authors: Jie Cai, Michael Strube
• Keywords: CEAF Coreference Resolution, Coreference Resolution Evaluation, Natural Language Processing, Resolution Evaluation Metrics, SIGDIAL 2010