Document Clustering Using Linear Partitioning Hyperplanes and Reallocation

12 years 11 months ago
Document Clustering Using Linear Partitioning Hyperplanes and Reallocation
This paper presents a novel algorithm for document clustering based on a combinatorial framework of the Principal Direction Divisive Partitioning (PDDP) algorithm [1] and a simplified version of the EM algorithm called the spherical Gaussian EM (sGEM) algorithm. The idea of the PDDP algorithm is to recursively split data samples into two subclusters using the hyperplane normal to the principal direction derived from the covariance matrix. However, the PDDP algorithm can yield poor results, especially when clusters are not well-separated from one another. To improve the quality of the clustering results, we deal with this problem by re-allocating new cluster membership using the sGEM algorithm with different settings. Furthermore, based on the theoretical background of the sGEM algorithm, we can naturally extend the framework to cover the problem of estimating the number of clusters using the Bayesian Information Criterion. Experimental results on two different corpora are given to ...
Canasai Kruengkrai, Virach Sornlertlamvanich, Hito
Added 30 Jun 2010
Updated 30 Jun 2010
Type Conference
Year 2004
Where AIRS
Authors Canasai Kruengkrai, Virach Sornlertlamvanich, Hitoshi Isahara
Comments (0)