Sciweavers

Share
JUCS
2010

LemmaGen: Multilingual Lemmatisation with Induced Ripple-Down Rules

8 years 3 months ago
LemmaGen: Multilingual Lemmatisation with Induced Ripple-Down Rules
: Lemmatisation is the process of finding the normalised forms of words appearing in text. It is a useful preprocessing step for a number of language engineering and text mining tasks, and especially important for languages with rich inflectional morphology. This paper presents a new lemmatisation system, LemmaGen, which was trained to generate accurate and efficient lemmatisers for twelve different languages. Its evaluation on the corresponding lexicons shows that LemmaGen outperforms the lemmatisers generated by two alternative approaches, RDR and CST, both in terms of accuracy and efficiency. To our knowledge, LemmaGen is the most efficient publicly available lemmatiser trained on large lexicons of multiple languages, whose learning engine can be retrained to effectively generate lemmatisers of other languages. Key Words: rule induction, ripple-down rules, natural language processing, lemmatisation Category: I.2.6, I.2.7, E.1
Matjaz Jursic, Igor Mozetic, Tomaz Erjavec, Nada L
Added 29 Jan 2011
Updated 29 Jan 2011
Type Journal
Year 2010
Where JUCS
Authors Matjaz Jursic, Igor Mozetic, Tomaz Erjavec, Nada Lavrac
Comments (0)
books