An Improved Data Anomaly Detection Method Based on Isolation Forest

被引:38
|
作者
Xu, Dong [1 ]
Wang, Yanjun [1 ]
Meng, Yulong [1 ]
Zhang, Ziying [1 ]
机构
[1] Harbin Engn Univ, Coll Comp Sci & Technol, Harbin 150001, Heilongjiang, Peoples R China
关键词
Isolation Forest; Outlier detection; SA-iForest; Simulated annealing;
D O I
10.1109/ISCID.2017.202
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
An improved data anomaly detection method SA-iForest is proposed to solve the problem of low accuracy, poor execution efficiency and generalization ability of data anomalies detection algorithm based on isolated forest. Based on the idea of selective integration, the precision and the difference value are taken as the criterion, and the simulated annealing algorithm is used to select the isolation tree with high abnormality detection and differentity to optimize the forest. At the same time, the excess detection precision is small and the difference is small Isolation tree improves the forest construction process of isolated forests, which improves the efficiency of the algorithm and improves the efficiency of the algorithm. The method of data anomaly detection based on SA-iForest is compared with the traditional Isolation Forest algorithm and LOF algorithm, and the accuracy and efficiency of the data are verified by the standard simulation data set. There is a significant improvement.
引用
收藏
页码:287 / 291
页数:5
相关论文
共 50 条
  • [41] An Improved Data-Efficiency Algorithm Based on Combining Isolation Forest and Mean Shift for Anomaly Data Filtering in Wind Power Curve
    Wang, Wei
    Yang, Shiyou
    Yang, Yankun
    ENERGIES, 2022, 15 (13)
  • [42] Anomaly Detection in Semiconductor Cleanroom Using Isolation Forest
    Jahan, Israt
    Alam, Md Morshed
    Ahmed, Md Faisal
    Jang, Yeong Min
    12TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC 2021): BEYOND THE PANDEMIC ERA WITH ICT CONVERGENCE INNOVATION, 2021, : 795 - 797
  • [43] Isolation Mondrian Forest for Batch and Online Anomaly Detection
    Ma, Haoran
    Ghojogh, Benyamin
    Samad, Maria N.
    Zheng, Dongyu
    Crowley, Mark
    2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 3051 - 3058
  • [44] Subspace analysis isolation forest for hyperspectral anomaly detection
    Huang Y.
    Xue Y.
    Li P.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2021, 50 (03): : 416 - 425
  • [45] CADI: Contextual Anomaly Detection using an Isolation Forest
    Yepmo, Veronne
    Smits, Gregory
    Lesot, Marie-Jeanne
    Pivert, Olivier
    39TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, SAC 2024, 2024, : 935 - 944
  • [46] Semi-Supervised Isolation Forest for Anomaly Detection
    Stradiotti, Luca
    Perini, Lorenzo
    Davis, Jesse
    PROCEEDINGS OF THE 2024 SIAM INTERNATIONAL CONFERENCE ON DATA MINING, SDM, 2024, : 670 - 678
  • [47] An improved agglomerative hierarchical clustering anomaly detection method for scientific data
    Shi, Peng
    Zhao, Zhen
    Zhong, Huaqiang
    Shen, Hangyu
    Ding, Lianhong
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (06):
  • [48] Improved Subspace Method for Supervised Anomaly Detection with Minimal Anomalous Data
    Ebuchi, Fumito
    Suzuki, Aiga
    Murakawa, Masahiro
    ICPRAM: PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION APPLICATIONS AND METHODS, 2020, : 151 - 158
  • [49] An Improved Anomaly Detection Method Based on Fuzzy Association Rules
    Yang, Zifen
    2010 INTERNATIONAL COLLOQUIUM ON COMPUTING, COMMUNICATION, CONTROL, AND MANAGEMENT (CCCM2010), VOL I, 2010, : 474 - 477
  • [50] An Improved Anomaly Detection Method Based on Fuzzy Association Rules
    Yang, Zifen
    PROCEEDINGS OF THE 2011 INTERNATIONAL CONFERENCE ON INFORMATICS, CYBERNETICS, AND COMPUTER ENGINEERING (ICCE2011), VOL 1: INTELLIGENT CONTROL AND NETWORK COMMUNICATION, 2011, 110 (01): : 441 - 447