Outliers Detection in Regressions by Nonparametric Parzen Kernel Estimation

被引:0
|
作者
Galkowski, Tomasz [1 ]
Cader, Andrzej [2 ,3 ]
机构
[1] Czestochowa Tech Univ, Inst Computat Intelligence, Czestochowa, Poland
[2] Univ Social Sci, Inst Informat Technol, PL-90113 Lodz, Poland
[3] Clark Univ, Worcester, MA 01610 USA
关键词
Outlier detection; Regression; Nonparametric estimation; SYSTEMS; DESIGN;
D O I
10.1007/978-3-319-91262-2_32
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A certain observation which is unusual or different from all other ones is called the outlier or anomaly. Appropriate evaluation of data is a crucial problem in modelling of the real objects or phenomena. Actually investigated problems often are based on data mass-produced by computer systems, without careful inspection or screening. The great amount of generated and processed information (e.g. so-called Big-Data) cause that possible outliers often go unnoticed and the result is that they can be masked. However, in regression, this situation can be more complicated. The identification and evaluation of the extremely atypical measurements in observations, for instance in some areas of medicine, geology, particularly in seismology (earthquakes), is precisely the outliers that are the subjects of interest. In this paper, a nonparametric procedure based on Parzen kernel for estimation of unknown function is applied. Evaluation of which measurements in input data-set could be recognized as outliers and possibly should be removed has been performed using the Cook's Distance formula. Anomaly detection is still an important problem to be researched within diverse areas and application domains.
引用
收藏
页码:354 / 363
页数:10
相关论文
共 50 条
  • [1] Combining forecasts with nonparametric kernel regressions
    Li, FC
    Tkacz, G
    [J]. STUDIES IN NONLINEAR DYNAMICS AND ECONOMETRICS, 2004, 8 (04):
  • [2] Modification of Nonparametric Probability Density Estimation of Parzen's Type with Implicitly Given form of Kernel Function
    Lapko, Aleksandr V.
    Lapko, Vasiliy A.
    Yuronen, Ekaterina A.
    [J]. 2018 INTERNATIONAL SCIENTIFIC MULTI-CONFERENCE ON INDUSTRIAL ENGINEERING AND MODERN TECHNOLOGIES (FAREASTCON), 2018,
  • [3] NONPARAMETRIC SALIENCY DETECTION USING KERNEL DENSITY ESTIMATION
    Liu, Zhi
    Xue, Yinzhu
    Shen, Liquan
    Zhang, Zhaoyang
    [J]. 2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 253 - 256
  • [4] Nonparametric estimation of multiple structures with outliers
    Zhang, Wei
    Kosecka, Jana
    [J]. DYNAMICAL VISION, 2007, 4358 : 60 - +
  • [5] Object detection by clustering-based nonparametric kernel density estimation
    Hu, D.
    Hu, J.
    [J]. INFORMATION SCIENCE AND MANAGEMENT ENGINEERING, VOLS 1-3, 2014, 46 : 1867 - 1872
  • [6] Nonparametric Estimate of a Parzen-Type Probability Density with an Implicitly Specified Form of the Kernel
    Lapko, A. V.
    Lapko, V. A.
    [J]. MEASUREMENT TECHNIQUES, 2016, 59 (06) : 571 - 576
  • [7] Combining Stock Market Volatility Forecasts Using Nonparametric Kernel Regressions
    Dong, Jiang-rong
    You, Yong
    [J]. ADVANCES IN BUSINESS INTELLIGENCE AND FINANCIAL ENGINEERING, 2008, 5 : 365 - +
  • [8] Nonparametric tests for detection of high dimensional outliers
    Modarres, Reza
    [J]. JOURNAL OF NONPARAMETRIC STATISTICS, 2022, 34 (01) : 206 - 227
  • [9] A NONPARAMETRIC SURVIVAL FUNCTION ESTIMATOR VIA CENSORED KERNEL QUANTILE REGRESSIONS
    Shin, Seung Jun
    Zhang, Hao Helen
    Wu, Yichao
    [J]. STATISTICA SINICA, 2017, 27 (01) : 457 - 478
  • [10] Nonparametric Estimate of a Parzen-Type Probability Density with an Implicitly Specified Form of the Kernel
    A. V. Lapko
    V. A. Lapko
    [J]. Measurement Techniques, 2016, 59 : 571 - 576