Sciweavers

Share
COLING
1992

Word-Sense Disambiguation Using Statistical Models of Roget's Categories Trained on Large Corpora

10 years 7 months ago
Word-Sense Disambiguation Using Statistical Models of Roget's Categories Trained on Large Corpora
This paper describes a program that disambignates English word senses in unrestricted text using statistical models of the major Roget's Thesaurus categories. Roget's categories serve as approximations of conceptual classes. The categories listed for a word in Roger's index tend to correspond to sense distinctions; thus selecting the most likely category provides a useful level of sense disambiguatiou. The selection of categories is accomplished by identifying and weighting words that are indicative of each category when seen in context, using a Bayesian theoretical framework. Other statistical approaches have required special corpora or hand-labeled training examples for much of the lexicon. Our use of class models overcomes this knowledge acquisition bottleneck, enabling training on unresUicted monolingual text without human intervention. Applied to the 10 million word Grolier's Encyclopedia, the system correctly disambiguated 92% of the instances of 12 polysemou...
David Yarowsky
Added 07 Nov 2010
Updated 07 Nov 2010
Type Conference
Year 1992
Where COLING
Authors David Yarowsky
Comments (0)
books