Evaluation Metrics for Automatic Temporal Annotation of Texts

Recent years have seen increasing attention in temporal processing of texts as well as a lot of standardization effort of temporal information in natural language. A central part of this information lies in the temporal relations between events described in a text, when their precise times or dates are not known. Reliable human annotation of such information is difficult, and automatic comparisons must follow procedures beyond mere precision-recall of local pieces of information, since a coherent picture can only be considered at a global level. We address the problem of evaluation metrics of such information, aiming at fair comparisons between systems, by proposing some measures taking into account the globality of a text.

• Type: Conference
• Year: 2008
• Where: LREC
• Authors: Xavier Tannier, Philippe Muller
• Keywords: Education, LREC 2008, Reliable Human Annotation, Temporal Processing, Temporal Relations