Outlier identification in high dimensions

13 years 4 months ago

Download www.statistik.tuwien.ac.at

A computationally fast procedure for identifying outliers is presented, that is particularly effective in high dimensions. This algorithm utilizes simple properties of principal components to identify outliers in the transformed space, leading to significant computational advantages for high dimensional data. This approach requires considerably less computational time than existing methods for outlier detection, and is suitable for use on very large data sets. It is also capable of analyzing the data situation commonly found in certain biological applications in which the number of dimensions is several orders of magnitude larger than the number of observations. The performance of this method is illustrated on real and simulated data with dimension ranging in the thousands. Key words: Outlier identification, robust estimators, high dimension, robust principal components.

Peter Filzmoser, Ricardo A. Maronna, Mark Werner

Real-time Traffic