Combining Wikipedia-Based Concept Models for Cross-Language Retrieval

9 years 8 months ago
Combining Wikipedia-Based Concept Models for Cross-Language Retrieval
Abstract. As a low-cost ressource that is up-to-date, Wikipedia recently gains attention as a means to provide cross-language brigding for information retrieval. Contradictory to a previous study, we show that standard Latent Dirichlet Allocation (LDA) can extract cross-language information that is valuable for IR by simply normalizing the training data. Furthermore, we show that LDA and Explicit Semantic Analysis (ESA) complement each other, yielding significant improvements when combined. Such a combination can significantly contribute to retrieval based on machine translation, especially when query translations contain errors. The experiments were perfomed on the Multext JOC corpus und a CLEF dataset. Key words: Latent dirichlet allocation, explicit semantic analysis, crosslanguage information retrieval, machine translation
Benjamin Roth, Dietrich Klakow
Added 19 Jul 2010
Updated 19 Jul 2010
Type Conference
Year 2010
Where IRFC
Authors Benjamin Roth, Dietrich Klakow
Comments (0)