Sciweavers

Share
NIPS
2008

Logistic Normal Priors for Unsupervised Probabilistic Grammar Induction

11 years 1 months ago
Logistic Normal Priors for Unsupervised Probabilistic Grammar Induction
We explore a new Bayesian model for probabilistic grammars, a family of distributions over discrete structures that includes hidden Markov models and probabilistic context-free grammars. Our model extends the correlated topic model framework to probabilistic grammars, exploiting the logistic normal distribution as a prior over the grammar parameters. We derive a variational EM algorithm for that model, and then experiment with the task of unsupervised grammar induction for natural language dependency parsing. We show that our model achieves superior results over previous models that use different priors.
Shay B. Cohen, Kevin Gimpel, Noah A. Smith
Added 29 Oct 2010
Updated 29 Oct 2010
Type Conference
Year 2008
Where NIPS
Authors Shay B. Cohen, Kevin Gimpel, Noah A. Smith
Comments (0)
books