A Local Outlier Detection Method Based on Objective Function

被引:0
|
作者
Zhou Y. [1 ]
Zhu W.-H. [1 ]
Sun H.-Y. [1 ]
机构
[1] School of Electric Power, North China University of Water Resources and Electric Power, Zhengzhou
关键词
fuzzy C-means (FCM) algorithm; local outlier factor(LOF); objective function; outlier detection; pruning;
D O I
10.12068/j.issn.1005-3026.2022.10.006
中图分类号
学科分类号
摘要
The traditional density based local outlier detection algorithm does not preprocess the original data set, which leads to the unsatisfactory detection effect when facing the unknown data set. Moreover, due to the need to calculate the outlier factor of each data point, the amount of calculation increases greatly when the amount of data is too large. Through the analysis of the local outlier detection algorithm, a local outlier detection method based on objective function FOLOF(FCM objective function-based LOF) is proposed. Firstly, the elbow rule is used to determine the optimal number of clusters in the data set. Then, the data set is pruned by the objective function of FCM to obtain the outlier candidate set. Finally, the weighted local outlier factor detection algorithm is used to calculate the outlier degree of each point in the candidate set. The relevant experiments are carried out on the artificial data set and UCI data sets. At the same time, the proposed method is compared with other methods. The results show that the proposed algorithm can improve the outlier detection accuracy, reduce the computational cost, and effectively achieve a better performance. © 2022 Northeastern University. All rights reserved.
引用
收藏
页码:1405 / 1412
页数:7
相关论文
共 25 条
  • [1] Hawkins D., Identification of outliers[M], (1980)
  • [2] Ji Z., Advancements of outlier detection:a survey, ICST Transactions on Scalable Information Systems, 13, 1, pp. 1-24, (2013)
  • [3] Vijayakumar V, Sri N, Sarojini P., Isolation forest and local outlier factor for credit card fraud detection system [ J ], International Journal of Engineering and Advanced Technology, 4, 9, pp. 261-265, (2020)
  • [4] Wang F, Wei Z, Zuo X., Anomaly IoT node detection based on local outlier factor and time series [ J ], Computers, Materials &Continua, 2, 64, pp. 1063-1073, (2020)
  • [5] Yuan X, Li J, Bai J, A local outlier factor-based detection of copy number variations from NGS data [ J ], IEEE / ACM Transactions on Computational Biology and Bioinformatics, 99, (2019)
  • [6] Wu Qiang, Zhang Rui, Wavelet denoising of near earth all sky time star map based on local anomaly factor [J], Journal of Optics, 40, 8, pp. 46-54, (2020)
  • [7] Liu X, Cheung Y M, Peng S J, Et al., Automatic mitral valve leaflet tracking in Echocardiography via constrained outlier pursuit and region-scalable active contours [ J ], Neurocomputing, 144, pp. 47-57, (2014)
  • [8] Zhou Yu, Zhu Wen-hao, Fang Qian, Et al., Research review of outlier detection methods based on clustering [ J ], Computer Engineering and Application, 57, 12, pp. 37-45, (2021)
  • [9] Mei Lin, Zhang Feng-li, Gao Qiang, Overview of outlier detection technology [ J], Computer Application Research, 37, 2, pp. 3521-3527, (2020)
  • [10] Breuning M, Krigegel H P, Ng R, Et al., LOF: identifying density based local outliers [ C ], Proceeding of the ACM SIGMOD International Conference on Management of Data, pp. 93-104, (2000)