Sciweavers

ACL
2009

Optimizing Language Model Information Retrieval System with Expectation Maximization Algorithm

13 years 1 months ago
Optimizing Language Model Information Retrieval System with Expectation Maximization Algorithm
Statistical language modeling (SLM) has been used in many different domains for decades and has also been applied to information retrieval (IR) recently. Documents retrieved using this approach are ranked according their probability of generating the given query. In this paper, we present a novel approach that employs the generalized Expectation Maximization (EM) algorithm to improve language models by representing their parameters as observation probabilities of Hidden Markov Models (HMM). In the experiments, we demonstrate that our method outperforms standard SLM-based and tf.idfbased methods on TREC 2005 HARD Track data.
Justin Liang-Te Chiu, Jyun-Wei Huang
Added 16 Feb 2011
Updated 16 Feb 2011
Type Journal
Year 2009
Where ACL
Authors Justin Liang-Te Chiu, Jyun-Wei Huang
Comments (0)