NDPMine: Efficiently Mining Discriminative Numerical Features for Pattern-Based Classification

Abstract. Pattern-based classification has demonstrated its power in recent studies, but because the cost of mining discriminative patterns as features in classification is very expensive, several efficient algorithms have been proposed to rectify this problem. These algorithms assume that feature values of the mined patterns are binary, i.e., a pattern either exists or not. In some problems, however, the number of times a pattern appears is more informative than whether a pattern appears or not. To resolve these deficiencies, we propose a mathematical programming method that directly mines discriminative patterns as numerical features for classification. We also propose a novel search space shrinking technique which addresses the inefficiencies in iterative pattern mining algorithms. Finally, we show that our method is an order of magnitude faster, significantly more memory efficient and more accurate than current approaches.

• Type: Journal
• Year: 2010
• Where: PKDD
• Authors: Hyungsul Kim, Sangkyum Kim, Tim Weninger, Jiawei Han, Tarek F. Abdelzaher
• Keywords: Algorithms, Data Mining, Discriminative Patterns, PKDD 2010, Space Shrinking Technique