Sciweavers

Share
CSDA
2006

Two-way Poisson mixture models for simultaneous document classification and word clustering

9 years 3 months ago
Two-way Poisson mixture models for simultaneous document classification and word clustering
An approach to simultaneous document classification and word clustering is developed using a two-way mixture model of Poisson distributions. Each document is represented by a vector with each dimension specifying the number of occurrences of a particular word in the document in question. As a collection of documents across several classes usually makes use of a large number of words, the document vectors are of high dimension. On the other hand, the number of distinct words in any single document is usually substantially smaller than the size of the vocabulary, leading to sparse document vectors. A mixture of Poisson distributions is used to model the multivariate distribution of the word counts in the documents within each class. To address the issues of high dimensionality and sparsity, the parameters in the mixture model are regularized by imposing a clustering structure on the set of words.An EM-style algorithm for the two-way mixture model will be derived for parameter estimation...
Jia Li, Hongyuan Zha
Added 11 Dec 2010
Updated 11 Dec 2010
Type Journal
Year 2006
Where CSDA
Authors Jia Li, Hongyuan Zha
Comments (0)
books