Back to Search Start Over

Thresholding-based outlier detection for high-dimensional data.

Authors :
Yang, Xiaona
Wang, Zhaojun
Zi, Xuemin
Source :
Journal of Statistical Computation & Simulation. Jul2018, Vol. 88 Issue 11, p2170-2184. 15p.
Publication Year :
2018

Abstract

Traditional outlier detection methods such as the minimum volume ellipsoid method and MCD method are all based on <inline-graphic></inline-graphic> normal distance. As is well known, the <inline-graphic></inline-graphic> norm-based distance is only effective in detecting difference with dense signals. However, these existing approaches will encounter detection power loss under the sparse signals settings. In this paper, we try to solve the problem of detecting outliers under the sparsity assumption by adapting the thresholding method. The proposed outlier detection procedure finds the clean set by the minimum diagonal product algorithm, then the maximum thresholding statistic is employed to identify the outlier. The finite sample performance of our method is evaluated through simulations. Compared with the existing outlier detection methods, simulation results show that our proposed outlier detection procedure is very efficient under sparse settings. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
00949655
Volume :
88
Issue :
11
Database :
Academic Search Index
Journal :
Journal of Statistical Computation & Simulation
Publication Type :
Academic Journal
Accession number :
130021394
Full Text :
https://doi.org/10.1080/00949655.2018.1452238