DensEst: Density Estimation for Data Mining in High Dimensional Spaces.

Subspace clustering and frequent itemset mining via “stepby-step” algorithms that search the subspace/pattern lattice in a top-down or bottom-up fashion do not scale to large high dimensional data bases. Recent “jump” algorithms directly choose candidate subspace regions or patterns. Their scalability and quality depend heavily on the rating of these candidates as mislead jumps incur poor results and costly candidate refinements. Existing techniques rely on simple statistics with low estimation quality or on inefficient data base scans. In this work, we propose DensEst, an efficient density estimator with significantly improved accuracy. It efficiently provides rough estimates of object counts in selective subspace regions. Furthermore, by incorporating correlations between dimensions DensEst achieves not only efficient but also highly accurate estimations. We show how this density estimation technique can be easily integrated into subspace clustering and frequent itemset mi...

• Type: Conference
• Year: 2009
• Where: SDM
• Authors: Emmanuel Müller, Ira Assent, Ralph Krieger, Stephan Günnemann, Thomas Seidl
• Keywords: Candidate Subspace Regions, Computer Science, Density Estimation Technique, SDM 2009, Selective Subspace Regions