An Improved Data Anomaly Detection Method Based on Isolation Forest

被引:38
|
作者
Xu, Dong [1 ]
Wang, Yanjun [1 ]
Meng, Yulong [1 ]
Zhang, Ziying [1 ]
机构
[1] Harbin Engn Univ, Coll Comp Sci & Technol, Harbin 150001, Heilongjiang, Peoples R China
关键词
Isolation Forest; Outlier detection; SA-iForest; Simulated annealing;
D O I
10.1109/ISCID.2017.202
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
An improved data anomaly detection method SA-iForest is proposed to solve the problem of low accuracy, poor execution efficiency and generalization ability of data anomalies detection algorithm based on isolated forest. Based on the idea of selective integration, the precision and the difference value are taken as the criterion, and the simulated annealing algorithm is used to select the isolation tree with high abnormality detection and differentity to optimize the forest. At the same time, the excess detection precision is small and the difference is small Isolation tree improves the forest construction process of isolated forests, which improves the efficiency of the algorithm and improves the efficiency of the algorithm. The method of data anomaly detection based on SA-iForest is compared with the traditional Isolation Forest algorithm and LOF algorithm, and the accuracy and efficiency of the data are verified by the standard simulation data set. There is a significant improvement.
引用
收藏
页码:287 / 291
页数:5
相关论文
共 50 条
  • [1] An Anomaly Detection Method for Wireless Sensor Networks Based on the Improved Isolation Forest
    Chen, Junxiang
    Zhang, Jilin
    Qian, Ruixiang
    Yuan, Junfeng
    Ren, Yongjian
    APPLIED SCIENCES-BASEL, 2023, 13 (02):
  • [2] Distribution Forest: An Anomaly Detection Method Based on Isolation Forest
    Yao, Chengfei
    Ma, Xiaoqing
    Chen, Biao
    Zhao, Xiaosong
    Bai, Gang
    ADVANCED PARALLEL PROCESSING TECHNOLOGIES (APPT 2019), 2019, 11719 : 135 - 147
  • [3] Spectral-Spatial Anomaly Detection of Hyperspectral Data Based on Improved Isolation Forest
    Song, Xiangyu
    Aryal, Sunil
    Ting, Kai Ming
    Liu, Zhen
    He, Bin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] Anomaly credit data detection based on enhanced Isolation Forest
    Zhang, Xiaodong
    Yao, Yuan
    Lv, Congdong
    Wang, Tao
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2022, 122 (01): : 185 - 192
  • [5] Anomaly credit data detection based on enhanced Isolation Forest
    Xiaodong Zhang
    Yuan Yao
    Congdong Lv
    Tao Wang
    The International Journal of Advanced Manufacturing Technology, 2022, 122 : 185 - 192
  • [6] Improved Anomaly Detection by Using the Attention-Based Isolation Forest
    Utkin, Lev
    Ageev, Andrey
    Konstantinov, Andrei
    Muliukha, Vladimir
    ALGORITHMS, 2023, 16 (01)
  • [7] A mathematical assessment of the isolation random forest method for anomaly detection in big data
    Morales, Fernando A.
    Ramirez, Jorge M.
    Ramos, Edgar A.
    MATHEMATICAL METHODS IN THE APPLIED SCIENCES, 2023, 46 (01) : 1156 - 1177
  • [8] Leveraging an Isolation Forest to Anomaly Detection and Data Clustering
    Yepmo, Veronne
    Smits, Gregory
    Lesot, Marie -Jeanne
    Pivert, Olivier
    DATA & KNOWLEDGE ENGINEERING, 2024, 151
  • [9] Anomaly Detection in Streaming Data using Isolation Forest
    Kareem, Mohammed Shaker
    Muhammed, Lamia AbedNoor
    PROCEEDINGS 2024 SEVENTH INTERNATIONAL WOMEN IN DATA SCIENCE CONFERENCE AT PRINCE SULTAN UNIVERSITY, WIDS-PSU 2024, 2024, : 223 - 228
  • [10] Isolation Forest Based Anomaly Detection Framework on Non-IID Data
    Xiang, Haolong
    Wang, Jiayu
    Ramamohanarao, Kotagiri
    Salcic, Zoran
    Dou, Wanchun
    Zhang, Xuyun
    IEEE INTELLIGENT SYSTEMS, 2021, 36 (03) : 31 - 40