Training Global Linear Models for Chinese Word Segmentation

This paper examines how one can obtain state of the art Chinese word segmentation using global linear models. We provide experimental comparisons that give a detailed road-map for obtaining state of the art accuracy on various datasets. In particular, we compare the use of reranking with full beam search; we compare various methods for learning weights for features that are full sentence features, such as language model features; and, we compare an Averaged Perceptron global linear model with the Exponentiated Gradient max-margin algorithm.

• Type: Conference
• Year: 2009
• Where: AI
• Authors: Dong Song, Anoop Sarkar
• Keywords: AI 2009, Artificial Intelligence, Chinese Word Segmentation, Global Linear Model, Perceptron Global Linear