MANomaly: Mutual adversarial networks for semi-supervised anomaly detection

被引:20
|
作者
Zhang, Lianming [1 ]
Xie, Xiaowei [1 ]
Xiao, Kai [1 ]
Bai, Wenji [1 ]
Liu, Kui [1 ]
Dong, Pingping [1 ]
机构
[1] Hunan Normal Univ, Coll Informat Sci & Engn, Changsha 410081, Peoples R China
关键词
Network intrusion detection; Anomaly detection; Mutual adversarial network; Mutual adversarial training; High anomaly suppression; VEHICLES;
D O I
10.1016/j.ins.2022.08.033
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In network intrusion detection, since the available attack traffic is much less than normal traffic, detecting attacks and intrusions from these unbalanced traffic can be a problem of semi-supervised learning, i.e., finding outliers (anomalies) from a data population that obeys a certain distribution. In this paper, we design a novel network model named the mutual adversarial network (MAN), which has two identical reconstruction autoencoder (RecAE) subnetworks. In training, these two subnetworks use the proposed mutual adver-sarial training to learn the data distribution of normal traffic samples. In detection, we identify anomalies based on the residual values obtained after different samples are recon-structed by MAN. In addition, we devise a novel method to identify anomalies from anom-aly scores named the high anomaly suppression (HAS) determination mechanism, which uses the mean values to suppress the effect of noisy data in the test sample. Then, we con-struct a novel semi-supervised reconstruction anomaly detection framework named MANomaly by combining MAN with the HAS determination mechanism. Meanwhile, we design three different mutual adversarial training approaches to MANomaly and evaluate them on two publicly available network traffic datasets: NSL-KDD and UNSW-NB15. Experimental results show that our method achieves excellent performance by using only 5% of normal training data. (c) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页码:65 / 80
页数:16
相关论文
共 50 条
  • [31] Statistical approaches for semi-supervised anomaly detection in machining
    Denkena, B.
    Dittrich, M-A
    Noske, H.
    Witt, M.
    PRODUCTION ENGINEERING-RESEARCH AND DEVELOPMENT, 2020, 14 (03): : 385 - 393
  • [32] Anomaly and Novelty detection for robust semi-supervised learning
    Cappozzo, Andrea
    Greselin, Francesca
    Murphy, Thomas Brendan
    STATISTICS AND COMPUTING, 2020, 30 (05) : 1545 - 1571
  • [33] Semi-Supervised Statistical Approach for Network Anomaly Detection
    Aissa, Naila Belhadj
    Guerroumia, Mohamed
    7TH INTERNATIONAL CONFERENCE ON AMBIENT SYSTEMS, NETWORKS AND TECHNOLOGIES (ANT 2016) / THE 6TH INTERNATIONAL CONFERENCE ON SUSTAINABLE ENERGY INFORMATION TECHNOLOGY (SEIT-2016) / AFFILIATED WORKSHOPS, 2016, 83 : 1090 - 1095
  • [34] Network anomaly detection based on semi-supervised clustering
    Wei Xiaotao
    Huang Houkuan
    Tian Shengfeng
    NEW ADVANCES IN SIMULATION, MODELLING AND OPTIMIZATION (SMO '07), 2007, : 440 - +
  • [35] Semi-Supervised Anomaly Detection Via Neural Process
    Zhou, Fan
    Wang, Guanyu
    Zhang, Kunpeng
    Liu, Siyuan
    Zhong, Ting
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (10) : 10423 - 10435
  • [36] Semi-supervised Deep Learning for Network Anomaly Detection
    Sun, Yuanyuan
    Guo, Lili
    Li, Ye
    Xu, Lele
    Wang, Yongming
    ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2019, PT II, 2020, 11945 : 383 - 390
  • [37] Semi-supervised anomaly detection in video surveillance by inpainting
    Liu, Wei
    Gao, Mingqiang
    Duan, Shuaidong
    Wei, Longsheng
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (16) : 47677 - 47698
  • [38] Semi-Supervised Active Learning for Anomaly Detection in Aviation
    Memarzadeh, Milad
    Matthews, Bryan
    Templin, Thomas
    Sharif Rohani, Aida
    Weckler, Daniel
    JOURNAL OF AEROSPACE INFORMATION SYSTEMS, 2023, 20 (04): : 181 - 194
  • [39] Semi-supervised Bolt Anomaly Detection in Haphazard Environment
    Liu, Chuangwei
    Yan, Yi
    Ma, Nachuan
    Peng, Yun
    Liu, Chengju
    Chen, Qijun
    2022 IEEE 18TH INTERNATIONAL CONFERENCE ON AUTOMATION SCIENCE AND ENGINEERING (CASE), 2022, : 882 - 887
  • [40] Semi-supervised Anomaly Detection with an Application to Water Analytics
    Vercruyssen, Vincent
    Meert, Wannes
    Verbruggen, Gust
    Maes, Koen
    Baumer, Ruben
    Davis, Jesse
    2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2018, : 527 - 536