LEARNING DISCRIMINATIVE FEATURES FOR SEMI-SUPERVISED ANOMALY DETECTION

被引:4
|
作者
Feng, Zhe [1 ]
Tang, Jie [1 ]
Dou, Yishun [1 ]
Wu, Gangshan [1 ]
机构
[1] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Jiangsu, Peoples R China
关键词
Anomaly detection; semi-supervised learning; transfer learning; sample reweighting; SUPPORT;
D O I
10.1109/ICASSP39728.2021.9414285
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Anomaly detection is the task of identifying unusual samples in data. Typically anomaly detection is defined on an unlabeled dataset that is assumed most of the samples are normal and others are anomalies. However, in industrial practice, one may have access to a part of annotated data. This gives us the potential for semi-supervised learning. In addition, existing methods assume all training data is normal and neglect the impact of a small number of anomalous samples. In this paper, we consolidate the model's discriminative power by introducing a transfer learning scheme to anomaly detection, thereby the model suffers less perturbation caused by pollution. We also propose a novel loss function to further adapt to semi-supervised data scenario. We ensure that the contribution of pollution can be well suppressed and reach a harmonious balance in magnitude of loss/gradient between unlabeled and labeled samples. Experiments on three publicly available datasets show that our method achieves state-of-the-art results.
引用
收藏
页码:2935 / 2939
页数:5
相关论文
共 50 条
  • [1] Semi-supervised Anomaly Detection with Reinforcement Learning
    Lee, Changheon
    Kim, JoonKyu
    Kang, Suk-Ju
    [J]. 2022 37TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC 2022), 2022, : 933 - 936
  • [2] DISCRIMINATIVE SEMI-SUPERVISED GENERATIVE ADVERSARIAL NETWORK FOR HYPERSPECTRAL ANOMALY DETECTION
    Jiang, Tao
    Xie, Weiying
    Li, Yunsong
    Du, Qian
    [J]. IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 2420 - 2423
  • [3] Anomaly and Novelty detection for robust semi-supervised learning
    Cappozzo, Andrea
    Greselin, Francesca
    Murphy, Thomas Brendan
    [J]. STATISTICS AND COMPUTING, 2020, 30 (05) : 1545 - 1571
  • [4] Semi-supervised Deep Learning for Network Anomaly Detection
    Sun, Yuanyuan
    Guo, Lili
    Li, Ye
    Xu, Lele
    Wang, Yongming
    [J]. ALGORITHMS AND ARCHITECTURES FOR PARALLEL PROCESSING, ICA3PP 2019, PT II, 2020, 11945 : 383 - 390
  • [5] Semi-Supervised Active Learning for Anomaly Detection in Aviation
    Memarzadeh, Milad
    Matthews, Bryan
    Templin, Thomas
    Sharif Rohani, Aida
    Weckler, Daniel
    [J]. JOURNAL OF AEROSPACE INFORMATION SYSTEMS, 2023, 20 (04): : 181 - 194
  • [6] Anomaly and Novelty detection for robust semi-supervised learning
    Andrea Cappozzo
    Francesca Greselin
    Thomas Brendan Murphy
    [J]. Statistics and Computing, 2020, 30 : 1545 - 1571
  • [7] Semi-supervised Machine Learning for Textual Anomaly Detection
    Steyn, Carl
    de Waal, Alta
    [J]. 2016 PATTERN RECOGNITION ASSOCIATION OF SOUTH AFRICA AND ROBOTICS AND MECHATRONICS INTERNATIONAL CONFERENCE (PRASA-ROBMECH), 2016,
  • [8] A Discriminative Model for Semi-Supervised Learning
    Balcan, Maria-Florina
    Blum, Avrim
    [J]. JOURNAL OF THE ACM, 2010, 57 (03)
  • [9] Learning discriminative features for semi-supervised person re-identification
    Cai, Huanhuan
    Huang, Lei
    Zhang, Wenfeng
    Wei, Zhiqiang
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (02) : 1787 - 1809
  • [10] Learning discriminative features for semi-supervised person re-identification
    Huanhuan Cai
    Lei Huang
    Wenfeng Zhang
    Zhiqiang Wei
    [J]. Multimedia Tools and Applications, 2022, 81 : 1787 - 1809