Continuous Adaptive Outlier Detection on Distributed Data Streams

In many applications, stream data are too voluminous to be collected in a central fashion and often transmitted on a distributed network. In this paper, we focus on the outlier detection over distributed data streams in real time, firstly, we formalize the problem of outlier detection using the kernel density estimation technique. Then, we adopt the fading strategy to keep pace with the transient and evolving natures of stream data, and mico-cluster technique to conquer the data partition and “one-pass” scan. Furthermore, our extensive experiments with synthetic and real data show that the proposed algorithm is efficient and effective compared with existing outlier detection algorithms, and more suitable for data streams.

• Type: Conference
• Year: 2007
• Where: HPCC
• Authors: Liang Su, Weihong Han, Shuqiang Yang, Peng Zou, Yan Jia
• Keywords: Data Streams, Distributed And Parallel Computing, HPCC 2007, Outlier Detection, Stream Data