Sciweavers

Share
ML
1998
ACM

The Hierarchical Hidden Markov Model: Analysis and Applications

10 years 4 months ago
The Hierarchical Hidden Markov Model: Analysis and Applications
We introduce, analyze and demonstrate a recursive hierarchical generalization of the widely used hidden Markov models, which we name Hierarchical Hidden Markov Models (HHMM). Our model is motivated by the complex multi-scale structure which appears in many natural sequences, particularly in language, handwriting and speech. We seek a systematic unsupervised approach to the modeling of such structures. By extending the standard Baum-Welch (forward-backward) algorithm, we derive an efficient procedure for estimating the model parameters from unlabeled data. We then use the trained model for automatic hierarchical parsing of observation sequences. We describe two applications of our model and its parameter estimation procedure. In the first application we show how to construct hierarchical models of natural English text. In these models different levels of the hierarchy correspond to structures on different length scales in the text. In the second application we demonstrate how HHMMs ca...
Shai Fine, Yoram Singer, Naftali Tishby
Added 22 Dec 2010
Updated 22 Dec 2010
Type Journal
Year 1998
Where ML
Authors Shai Fine, Yoram Singer, Naftali Tishby
Comments (0)
books