Selective ensemble method for anomaly detection based on parallel learning

被引:1
|
作者
Liu, Yansong [1 ,2 ]
Zhu, Li [1 ]
Ding, Lei [3 ]
Huang, Zifeng [4 ]
Sui, He [5 ,6 ]
Wang, Shuang [6 ]
Song, Yuedong [7 ]
机构
[1] Xi An Jiao Tong Univ, Sch Software Engn, Xian, Peoples R China
[2] Shandong Management Univ, Sch Intelligent Engn, Jinan, Peoples R China
[3] Guangzhou Univ, Sch Cyberspace Secur, Guangzhou, Peoples R China
[4] Guangzhou Univ, Sch Elect & Commun Engn, Guangzhou 510006, Peoples R China
[5] Civil Aviat Univ China, Coll Aeronaut Engn, Tianjin 300300, Peoples R China
[6] Civil Aviat Univ China, Informat Secur Evaluat Ctr Civil Aviat, Tianjin 300300, Peoples R China
[7] Shanghai Hua Xun Network Informat Syst Co Ltd, Shanghai 200135, Peoples R China
关键词
D O I
10.1038/s41598-024-51849-3
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Anomaly detection is a highly important task in the field of data analysis. Traditional anomaly detection approaches often strongly depend on data size, structure and features, while introducing the idea of ensemble into anomaly detection can greatly improve the generalization ability. Ensemble-based anomaly detection methods still face some challenges, however, such as data imbalance, time and space demand and the selection of base detectors. To this end, we propose a selective ensemble method for anomaly detection based on parallel learning (SEAD-PL). First, a differentiated stratified sampling method is designed to alleviate the problem of data imbalance. Then, a distributed parallel training frame is built to address the problem of excessive time and space consumption for base detector training. Finally, a clustering-based ensemble selection strategy is introduced to balance the accuracy and diversity of base detectors. Experiments are performed on six datasets, which demonstrate that the proposed method has obvious advantages over four selected methods.
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Selective ensemble method for anomaly detection based on parallel learning
    Yansong Liu
    Li Zhu
    Lei Ding
    Zifeng Huang
    He Sui
    Shuang Wang
    Yuedong Song
    Scientific Reports, 14
  • [2] Anomaly Detection Method Based on Clustering Undersampling and Ensemble Learning
    Huan, Wenming
    Lin, Haitao
    Lie, Haixue
    Zhou, Yan
    Wang, Yiming
    PROCEEDINGS OF 2020 IEEE 5TH INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC 2020), 2020, : 980 - 984
  • [3] Network anomaly detection based on selective ensemble algorithm
    Hongle Du
    Yan Zhang
    The Journal of Supercomputing, 2021, 77 : 2875 - 2896
  • [4] Network anomaly detection based on selective ensemble algorithm
    Du, Hongle
    Zhang, Yan
    JOURNAL OF SUPERCOMPUTING, 2021, 77 (03): : 2875 - 2896
  • [5] Active Anomaly Detection Technology Based on Ensemble Learning
    Liu, Weiwei
    Lei, Shuya
    Peng, Liangying
    Feng, Jun
    Pan, Sichen
    Gao, Meng
    DATA SCIENCE (ICPCSEE 2022), PT I, 2022, 1628 : 53 - 66
  • [6] Deep Anomaly Detection with Ensemble-Based Active Learning
    Tang, Xuning
    Astle, Yihua Shi
    Freeman, Craig
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 1663 - 1670
  • [7] AN ACCURACY NETWORK ANOMALY DETECTION METHOD BASED ON ENSEMBLE MODEL
    Liu, Fengrui
    Li, Xuefei
    Xiong, Wei
    Jiang, Haiyang
    Xie, Gaogang
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 8548 - 8552
  • [8] An Algorithm Design of Big Data Anomaly Detection Based on Ensemble Learning
    Chen, Xiao
    PROCEEDINGS OF 2024 INTERNATIONAL CONFERENCE ON COMPUTER AND MULTIMEDIA TECHNOLOGY, ICCMT 2024, 2024, : 319 - 323
  • [9] Wind turbines anomaly detection based on power curves and ensemble learning
    Moreno, Sinvaldo R.
    Coelho, Leandro dos Santos
    Ayala, Helon V. H.
    Mariani, Viviana Cocco
    IET RENEWABLE POWER GENERATION, 2020, 14 (19) : 4086 - 4093
  • [10] TSAEns: Ensemble Learning for KPI Anomaly Detection
    Wang, Chengyu
    Yang, Tao
    Cui, Jinhua
    Li, Yu
    Zhou, Tongqing
    Cai, Zhiping
    ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2021, PT I, 2022, 13155 : 162 - 177