Sciweavers

COLING
1992
13 years 6 months ago
Tokenization As The Initial Phase In NLP
In this paper, the authors address the significance and complexityof tokenization, the beginning step of NLP. Notions of word and token are discussed and defined from the viewpoin...
Jonathan J. Webster, Chunyu Kit