Sciweavers

Share
IPPS
2006
IEEE

Tree partition based parallel frequent pattern mining on shared memory systems

9 years 3 months ago
Tree partition based parallel frequent pattern mining on shared memory systems
In this paper, we present a tree-partition algorithm for parallel mining of frequent patterns. Our work is based on FP-Growth algorithm, which is constituted of tree-building stage and mining stage. The main idea is to build only one FP-Tree in the memory, partition it into several independent parts and distribute them to different threads. A heuristic algorithm is devised to balance the workload. Our algorithm can not only alleviate the impact of locks during the tree-building stage, but also avoid the overhead that do great harm to the mining stage. We present the experiments on different kinds of datasets and compare the results with other parallel approaches. The results suggest that our approach has great advantage in efficiency, especially on certain kinds of datasets. As the number of processors increases, our parallel algorithm shows good scalability.
Dehao Chen, Chunrong Lai, Wei Hu, Wenguang Chen, Y
Added 12 Jun 2010
Updated 12 Jun 2010
Type Conference
Year 2006
Where IPPS
Authors Dehao Chen, Chunrong Lai, Wei Hu, Wenguang Chen, Yimin Zhang, Weimin Zheng
Comments (0)
books