Confidence in Structured-Prediction Using Confidence-Weighted Models

11 years 11 months ago
Confidence in Structured-Prediction Using Confidence-Weighted Models
Confidence-Weighted linear classifiers (CW) and its successors were shown to perform well on binary and multiclass NLP problems. In this paper we extend the CW approach for sequence learning and show that it achieves state-of-the-art performance on four noun phrase chucking and named entity recognition tasks. We then derive few algorithmic approaches to estimate the prediction's correctness of each label in the output sequence. We show that our approach provides a reliable relative correctness information as it outperforms other alternatives in ranking label-predictions according to their error. We also show empirically that our methods output close to absolute estimation of error. Finally, we show how to use this information to improve active learning.
Avihai Mejer, Koby Crammer
Added 11 Feb 2011
Updated 11 Feb 2011
Type Journal
Year 2010
Authors Avihai Mejer, Koby Crammer
Comments (0)