Sciweavers

TSD
2010
Springer

Using TectoMT as a Preprocessing Tool for Phrase-Based Statistical Machine Translation

13 years 8 months ago
Using TectoMT as a Preprocessing Tool for Phrase-Based Statistical Machine Translation
Abstract. We present a systematic comparison of preprocessing techniques for two language pairs: English-Czech and English-Hindi. The two target languages, although both belonging to the Indo-European language family, show significant differences in morphology, syntax and word order. We describe how TectoMT, a successful framework for analysis and generation of language, can be used as preprocessor for a phrasebased MT system. We compare the two language pairs and the optimal sets of source-language transformations applied to them. The following transformations are examples of possible preprocessing steps: lemmatization; retokenization, compound splitting; removing/adding words lacking counterparts in the other language; phrase reordering to resemble the target word order; marking syntactic functions. TectoMT, as well as all other tools and data sets we use, are freely available on the Web. Key words: phrase-based translation, preprocessing, reordering
Daniel Zeman
Added 31 Jan 2011
Updated 31 Jan 2011
Type Journal
Year 2010
Where TSD
Authors Daniel Zeman
Comments (0)