On outlier detection with the Chebyshev type inequalities
Author(s) -
Michael A. Chepulis,
Georgy Shevlyakov
Publication year - 2020
Publication title -
journal of the belarusian state university mathematics and informatics
Language(s) - English
Resource type - Journals
eISSN - 2617-3956
pISSN - 2520-6508
DOI - 10.33581/2520-6508-2020-3-28-35
Subject(s) - outlier , chebyshev's inequality , chebyshev filter , mathematics , anomaly detection , multidimensional chebyshev's inequality , sigma , distribution (mathematics) , algorithm , scale (ratio) , inequality , approximation theory , computer science , data mining , statistics , rearrangement inequality , linear inequality , mathematical analysis , physics , quantum mechanics
This work considers algorithms of outlier detection based on the Chebyshev inequality. It compares these algorithms with such classical methods as Tukey’s boxplot, the N-sigma rule and its robust modifications based on MAD and FQ scale estimates. To adjust the parameters of the algorithms, a selection procedure is proposed based on the complete knowledge of the data distribution model. Areas of suboptimal parameters are also determined in case of incomplete knowledge of the distribution model. It is concluded that the direct use of the Chebyshev inequality implies the classical N-sigma rule. With the non-classical Chebyshev inequality, a robust outlier detection method is obtained, which slightly outperforms other considered algorithms.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom