Deep Optimal Isolation Forest with Genetic Algorithm for Anomaly Detection

被引:0
|
作者
Xiang, Haolong [1 ]
Zhang, Xuyun [1 ]
Dras, Mark [1 ]
Beheshti, Amin [1 ]
Dou, Wanchun [1 ]
Xu, Xiaolong [2 ]
机构
[1] Macquarie Univ, N Ryde, NSW 2109, Australia
[2] Nanjing Univ Informat Sci & Technol, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; deep isolation forest; genetic; algorithm; DOIForest; robustness;
D O I
10.1109/ICDM58522.2023.00077
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anomaly detection is one of the crucial research topics in artificial intelligence, encompassing various fields such as health monitoring, network intrusion detection, and fraud detection in financial transactions. Deep anomaly detection (DAD) methods are considered as the effective approaches for addressing complex anomaly detection problems. Among them, the deep isolation forest methods have gained rapid development recently due to their simplicity in parameter turning and efficiency in model training. The existing deep isolation forest approaches arc all based on representation learning, while OptiForest theoretically proves the crucial role of the tree structure in isolation forest based methods. In this paper, we analyse the search space of isolation trees under specific data instances and address the challenges in finding optimal isolation forest. Based on the theoretical underpinning and genetic algorithm, we design a deep model DOIForest with two mutation schemes and solution selection, which learns the optimal isolation forest and optimises the parameters in data partitioning. Extensive experiments on both synthetic dataset and a series of real world datasets demonstrate that our approach can achieve better detection accuracy and robustness than the state-of-the-arts.
引用
收藏
页码:678 / 687
页数:10
相关论文
共 50 条
  • [1] Deep Isolation Forest for Anomaly Detection
    Xu, Hongzuo
    Pang, Guansong
    Wang, Yijie
    Wang, Yongjun
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (12) : 12591 - 12604
  • [2] OptIForest: Optimal Isolation Forest for Anomaly Detection
    Xiang, Haolong
    Zhang, Xuyun
    Hu, Hongsheng
    Qi, Lianyong
    Dou, Wanchun
    Dras, Mark
    Beheshti, Amin
    Xu, Xiaolong
    [J]. PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 2379 - 2387
  • [3] DEEP LEARNING OF QINLING FOREST FIRE ANOMALY DETECTION BASED ON GENETIC ALGORITHM OPTIMIZATION
    Jiang, Yuan
    Wei, Rui
    Chen, Jian
    Wang, Guibao
    [J]. UNIVERSITY POLITEHNICA OF BUCHAREST SCIENTIFIC BULLETIN SERIES C-ELECTRICAL ENGINEERING AND COMPUTER SCIENCE, 2021, 83 (04): : 75 - 84
  • [4] Deep learning of qinling forest fire anomaly detection based on genetic algorithm optimization
    Jiang, Yuan
    Wei, Rui
    Chen, Jian
    Wang, Guibao
    [J]. UPB Scientific Bulletin, Series C: Electrical Engineering and Computer Science, 2021, 83 (04): : 75 - 84
  • [5] DeepiForest: A Deep Anomaly Detection Framework with Hashing Based Isolation Forest
    Xiang, Haolong
    Hu, Hongsheng
    Zhang, Xuyun
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2022, : 1251 - 1256
  • [6] A parallel algorithm for network traffic anomaly detection based on Isolation Forest
    Tao, Xiaoling
    Peng, Yang
    Zhao, Feng
    Zhao, Peichao
    Wang, Yong
    [J]. INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2018, 14 (11)
  • [7] Anomaly Detection with Generalized Isolation Forest
    Downey, Brett E.
    Leung, Carson K.
    Pazdor, Adam G. M.
    Petrillo, Ryan A. L.
    Popov, Denys
    Schneider, Benjamin R.
    [J]. ADVANCED INFORMATION NETWORKING AND APPLICATIONS, VOL 2, AINA 2024, 2024, 200 : 356 - 368
  • [8] Generalized isolation forest for anomaly detection
    Lesouple, Julien
    Baudoin, Cedric
    Spigai, Marc
    Tourneret, Jean-Yves
    [J]. PATTERN RECOGNITION LETTERS, 2021, 149 : 109 - 119
  • [9] Magnetic Anomaly Detection Method Based on Feature Fusion and Isolation Forest Algorithm
    Zhang, Ning
    Liu, Yifei
    Xu, Lei
    Lin, Pengfei
    Zhao, Heda
    Chang, Ming
    [J]. IEEE ACCESS, 2022, 10 : 84444 - 84457
  • [10] Hyperspectral Anomaly Detection With Kernel Isolation Forest
    Li, Shutao
    Zhang, Kunzhong
    Duan, Puhong
    Kang, Xudong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (01): : 319 - 329