A novel outlier detecting algorithm based on the outlier turning points

被引:13
|
作者
Huang, Jinlong [1 ]
Cheng, Dongdong [1 ]
Zhang, Sulan [1 ]
机构
[1] Yangtze Normal Univ, Coll Big Data & Intelligent Engn, Chongqing 408100, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
Outlier detection; Local outliers; Outlier clusters; Outlier turning points; NATURAL NEIGHBORHOOD GRAPH; CLUSTER;
D O I
10.1016/j.eswa.2023.120799
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Outlier detection is one of the hot research in data mining, and has been applied to various fields such as network anomaly detection, image abnormal analysis, etc. In recent years, many outlier detecting algorithms have been proposed. However, these outlier detecting algorithms are hard to effectively detect global outliers, local outliers and outlier clusters at the same time. In this paper, we propose a novel outlier detecting algorithm based on the following ideas: (1) the density distribution should not be changed dramatically on local area; (2) the ratio of the number of k nearest neighbors and the number of reverse k nearest neighbors should not be very big. Based on above ideas, the proposed algorithm aims to find outlier turning points, then regards all outlier turning points and its sparse neighbors as outliers. Furthermore, the proposed algorithm use natural neighbors to obtain the neighborhood parameter k adaptively. The formal analysis and extensive experiments demonstrate that this technique can detect global outliers, local outliers and outlier clusters without neighborhood parameter k.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] Outlier Respecting Points Approximation
    Chen, Danny Z.
    Wang, Haitao
    ALGORITHMICA, 2014, 69 (02) : 410 - 430
  • [22] Study on projected outlier detecting algorithm in high dimensional space
    Chen, JB
    Gao, YM
    ISTM/2005: 6TH INTERNATIONAL SYMPOSIUM ON TEST AND MEASUREMENT, VOLS 1-9, CONFERENCE PROCEEDINGS, 2005, : 5519 - 5522
  • [23] A New Outlier Detection Algorithm Based on Fast Density Peak Clustering Outlier Factor
    Zhang, ZhongPing
    Li, Sen
    Liu, WeiXiong
    Wang, Ying
    Li, Daisy Xin
    INTERNATIONAL JOURNAL OF DATA WAREHOUSING AND MINING, 2023, 19 (02)
  • [24] SDROF: outlier detection algorithm based on relative skewness density ratio outlier factor
    Zhang, Zhongping
    Wang, Kuo
    Dong, Jinyu
    Li, Sen
    APPLIED INTELLIGENCE, 2025, 55 (01)
  • [25] An Outlier Mining Algorithm Based on Attribute Entropy
    Zhou, Ming-Jian
    Tao, Jun-cai
    2011 2ND INTERNATIONAL CONFERENCE ON CHALLENGES IN ENVIRONMENTAL SCIENCE AND COMPUTER ENGINEERING (CESCE 2011), VOL 11, PT A, 2011, 11 : 132 - 138
  • [26] An incremental outlier factor based clustering algorithm
    Zhou, YF
    Liu, QB
    Deng, S
    Yang, Q
    2002 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-4, PROCEEDINGS, 2002, : 1358 - 1361
  • [27] An Effective Algorithm of Outlier Detection Based on Clustering
    Xia, Qingsong
    Xing, Changzheng
    Li, Na
    INTERNET OF THINGS-BK, 2012, 312 : 346 - 351
  • [28] Depth-Based Outlier Detection Algorithm
    Cardenas-Montes, Miguel
    HYBRID ARTIFICIAL INTELLIGENCE SYSTEMS, HAIS 2014, 2014, 8480 : 122 - 132
  • [29] An Outlier Cleaning Algorithm Based on Deep Learning
    Kuang, Junqian
    Zhao, Chang
    Yang, Liu
    Wang, Haifeng
    Qian, Hua
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (02) : 507 - 513
  • [30] An Outlier Detection Algorithm Based on Spectral Clustering
    Yang, Peng
    Huang, Biao
    PACIIA: 2008 PACIFIC-ASIA WORKSHOP ON COMPUTATIONAL INTELLIGENCE AND INDUSTRIAL APPLICATION, VOLS 1-3, PROCEEDINGS, 2008, : 485 - 488