An Improved Data Anomaly Detection Method Based on Isolation Forest

被引:38
|
作者
Xu, Dong [1 ]
Wang, Yanjun [1 ]
Meng, Yulong [1 ]
Zhang, Ziying [1 ]
机构
[1] Harbin Engn Univ, Coll Comp Sci & Technol, Harbin 150001, Heilongjiang, Peoples R China
关键词
Isolation Forest; Outlier detection; SA-iForest; Simulated annealing;
D O I
10.1109/ISCID.2017.202
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
An improved data anomaly detection method SA-iForest is proposed to solve the problem of low accuracy, poor execution efficiency and generalization ability of data anomalies detection algorithm based on isolated forest. Based on the idea of selective integration, the precision and the difference value are taken as the criterion, and the simulated annealing algorithm is used to select the isolation tree with high abnormality detection and differentity to optimize the forest. At the same time, the excess detection precision is small and the difference is small Isolation tree improves the forest construction process of isolated forests, which improves the efficiency of the algorithm and improves the efficiency of the algorithm. The method of data anomaly detection based on SA-iForest is compared with the traditional Isolation Forest algorithm and LOF algorithm, and the accuracy and efficiency of the data are verified by the standard simulation data set. There is a significant improvement.
引用
收藏
页码:287 / 291
页数:5
相关论文
共 50 条
  • [31] An anomaly detection approach based on the combination of LSTM autoencoder and isolation forest for multivariate time series data
    Phuong Hanh Tran
    Heuchenne, Cedric
    Thomassey, Sebastien
    DEVELOPMENTS OF ARTIFICIAL INTELLIGENCE TECHNOLOGIES IN COMPUTATION AND ROBOTICS, 2020, 12 : 589 - 596
  • [32] A parallel algorithm for network traffic anomaly detection based on Isolation Forest
    Tao, Xiaoling
    Peng, Yang
    Zhao, Feng
    Zhao, Peichao
    Wang, Yong
    INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2018, 14 (11)
  • [33] ISOLATION FOREST FOR ANOMALY DETECTION IN HYPERSPECTRAL IMAGES
    Zhang, Kunzhong
    Kang, Xudong
    Li, Shutao
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 437 - 440
  • [34] Anomaly Data Detection of Rolling Element Bearings Vibration Signal Based on Parameter Optimization Isolation Forest
    Wang, Haiming
    Li, Qiang
    Liu, Yongqiang
    Yang, Shaopu
    MACHINES, 2022, 10 (06)
  • [35] A Revised Isolation Forest procedure for Anomaly Detection with High Number of Data Points
    Marcelli, Elisa
    Barbariol, Tommaso
    Savarino, Vincenzo
    Beghi, Alessandro
    Susto, Gian Antonio
    2022 23RD IEEE LATIN-AMERICAN TEST SYMPOSIUM (LATS 2022), 2022,
  • [36] Flight parameter data anomaly detection method based on improved generative adversarial network
    Zhang P.
    Tian Z.-D.
    Wang H.
    Zhejiang Daxue Xuebao (Gongxue Ban)/Journal of Zhejiang University (Engineering Science), 2022, 56 (10): : 1967 - 1976+1986
  • [37] Anomaly Detection for Power Consumption Data based on Isolated Forest
    Mao, Wei
    Cao, Xiu
    Zhou, Qinhua
    Yan, Tong
    Zhang, Yongkang
    2018 INTERNATIONAL CONFERENCE ON POWER SYSTEM TECHNOLOGY (POWERCON), 2018, : 4169 - 4174
  • [38] Fault detection method for electric vehicle battery pack based on improved kurtosis and isolation forest
    Wu, Minghu
    Sheng, Yuhui
    Zhang, Fan
    Tang, Jing
    Hu, Sheng
    Zhao, Nan
    Wang, Juan
    Wang, Lujun
    International Journal of Green Energy, 2025, 22 (03) : 582 - 598
  • [39] Bilateral-Weighted Online Adaptive Isolation Forest for anomaly detection in streaming data
    Hannak, Gabor
    Horvath, Gabor
    Kadar, Attila
    Szalai, Mark Daniel
    STATISTICAL ANALYSIS AND DATA MINING, 2023, 16 (03) : 215 - 223
  • [40] Extending Isolation Forest for Anomaly Detection in Big Data via K-Means
    Laskar, Md Tahmid Rahman
    Huang, Jimmy Xiangji
    Smetana, Vladan
    Stewart, Chris
    Pouw, Kees
    An, Aijun
    Chan, Stephen
    Liu, Lei
    ACM TRANSACTIONS ON CYBER-PHYSICAL SYSTEMS, 2021, 5 (04)