Deep anomaly detection with self-supervised learning and adversarial training

被引:39
|
作者
Zhang, Xianchao [1 ,3 ]
Mu, Jie [1 ,3 ]
Zhang, Xiaotong [1 ,3 ]
Liu, Han [1 ,3 ]
Zong, Linlin [1 ,3 ]
Li, Yuangang [2 ]
机构
[1] Dalian Univ Technol, Sch Software, Dalian, Peoples R China
[2] Dalian Univ Foreign Languages, Dalian, Peoples R China
[3] Key Lab Ubiquitous Network & Serv Software Liaoni, Dalian, Peoples R China
基金
美国国家科学基金会;
关键词
Deep anomaly detection; Self-supervised learning; Adversarial training;
D O I
10.1016/j.patcog.2021.108234
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep anomaly detection, which utilizes neural networks to discover anomalies, is a vital research topic in pattern recognition. With the burgeoning of inference mechanism, inference-based methods show the promising performance. However, inference-based methods have two limitations: (1) they use an adver-sarial training way to learn data features. Such training way fails to learn task-specific features which can be conducive to capture the difference between normal and anomaly data. (2) The structure of detection network cannot capture the marginal distributions of normal data and corresponding features, which in-fluences on the performance of anomaly detection. To overcome these limitations, this paper proposes a deep adversarial anomaly detection (DAAD) method. Specifically, an auxiliary task with self-supervised learning is first designed to learn task-specific features. Then a deep adversarial training (DAT) model is constructed to capture marginal distributions of normal data in different spaces. In addition, a majority voting strategy is applied to obtain reliable detection results. Experimental results on image and sequence datasets show that proposed method performs significantly better than many strong baselines. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Self-Supervised Deep Learning Framework for Anomaly Detection in Traffic Data
    Morris, Clint
    Yang, Jidong J.
    Chorzepa, Mi Geum
    Kim, S. Sonny
    Durham, Stephan A.
    [J]. JOURNAL OF TRANSPORTATION ENGINEERING PART A-SYSTEMS, 2022, 148 (05)
  • [2] SELF-SUPERVISED ADVERSARIAL TRAINING
    Chen, Kejiang
    Chen, Yuefeng
    Zhou, Hang
    Mao, Xiaofeng
    Li, Yuhong
    He, Yuan
    Xue, Hui
    Zhang, Weiming
    Yu, Nenghai
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 2218 - 2222
  • [3] Anomaly Detection on Electroencephalography with Self-supervised Learning
    Xu, Junjie
    Zheng, Yaojia
    Mao, Yifan
    Wang, Ruixuan
    Zheng, Wei-Shi
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 363 - 368
  • [4] Deep, Self-Supervised Learning For Patient-Specific Anomaly Detection in Stereoelectroencephalography
    Martini, Michael
    Costa, Anthony
    Rajan, Kanaka
    Panov, Fedor
    Oermann, Eric
    [J]. JOURNAL OF NEUROSURGERY, 2020, 132 (04) : 37 - 37
  • [5] Self-Supervised Attentive Generative Adversarial Networks for Video Anomaly Detection
    Huang, Chao
    Wen, Jie
    Xu, Yong
    Jiang, Qiuping
    Yang, Jian
    Wang, Yaowei
    Zhang, David
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (11) : 9389 - 9403
  • [6] Self-supervised Learning for Anomaly Detection in Fundus Image
    Ahn, Sangil
    Shin, Jitae
    [J]. OPHTHALMIC MEDICAL IMAGE ANALYSIS, OMIA 2022, 2022, 13576 : 143 - 151
  • [7] CutPaste: Self-Supervised Learning for Anomaly Detection and Localization
    Li, Chun-Liang
    Sohn, Kihyuk
    Yoon, Jinsung
    Pfister, Tomas
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 9659 - 9669
  • [8] Augmentation Adversarial Training for Self-Supervised Speaker Representation Learning
    Kang, Jingu
    Huh, Jaesung
    Heo, Hee Soo
    Chung, Joon Son
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2022, 16 (06) : 1253 - 1262
  • [9] Sequential Adversarial Learning for Self-Supervised Deep Visual Odometry
    Li, Shunkai
    Xue, Fei
    Wang, Xin
    Yan, Zike
    Zha, Hongbin
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 2851 - 2860
  • [10] JOINT ANOMALY DETECTION AND INPAINTING FOR MICROSCOPY IMAGES VIA DEEP SELF-SUPERVISED LEARNING
    Huang, Ling
    Cheng, Deruo
    Yang, Xulei
    Lin, Tong
    Shi, Yiqiong
    Yang, Kaiyi
    Gwee, Bah Hwee
    Wen, Bihan
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3497 - 3501