Semi-Supervised Anomaly Detection Via Neural Process

被引:8
|
作者
Zhou, Fan [1 ]
Wang, Guanyu [1 ]
Zhang, Kunpeng [2 ]
Liu, Siyuan [3 ]
Zhong, Ting [1 ,4 ]
机构
[1] Univ Elect Sci & Technol China, Chengdu 610054, Sichuan, Peoples R China
[2] Univ Maryland, Dept Decis Operat & Informat Technol, College Pk, MD 20742 USA
[3] Penn State Univ, Dept Supply Chain & Informat Syst, State Coll, PA 16802 USA
[4] Kashi Inst Elect & Informat Ind, Kashi 844199, Xinjiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; neural networks; neural process; probabilistic models; semi-supervised learning;
D O I
10.1109/TKDE.2023.3266755
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many deep (semi-) supervised neural network-based methods have been proposed for anomaly detection, tackling the issue of limited labeled data. They have shown good performance but still face two major challenges. First, insufficient labeled data limits their flexibility. Second, measuring the uncertainty of the prediction, especially when dealing with objects deviating largely from training data, has not been well studied. Another common reason preventing them from prevailing is that they learn a determined function to make predictions from the input. This usually makes the predicted results uncertain and lacks robustness. To address these problems, we propose a novel framework, incorporating the neural process into the semi-supervised anomaly detection paradigm and efficiently using unlabeled data and a handful of labeled data in training. Different from other methods, ours is equivalent to modeling the distribution of functions representing anomalous patterns according to the labeled data rather than learning a single determined function for anomaly detection. Our approach improves the flexibility and robustness under the condition of insufficient training data, and can measure the uncertainty of prediction results. Extensive experiments under real-world datasets demonstrate that our proposed method can significantly improve anomaly detection performance compared to several cutting-edge benchmarks.
引用
收藏
页码:10423 / 10435
页数:13
相关论文
共 50 条
  • [41] Case Study: A Semi-Supervised Methodology for Anomaly Detection and Diagnosis
    Morales-Forero, A.
    Bassetto, S.
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL ENGINEERING AND ENGINEERING MANAGEMENT (IEEM), 2019, : 1031 - 1037
  • [42] Autoencoder based Semi-Supervised Anomaly Detection in Turbofan Engines
    Al Bataineh, Ali
    Mairaj, Aakif
    Kaur, Devinder
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2020, 11 (11) : 41 - 47
  • [43] Semi-Supervised Machine Learning for Spacecraft Anomaly Detection & Diagnosis
    Ramachandran, Sowmya
    Rosengarten, Maia
    Belardi, Christian
    [J]. 2020 IEEE AEROSPACE CONFERENCE (AEROCONF 2020), 2020,
  • [44] Semi-supervised Variational Multi-view Anomaly Detection
    Wang, Shaoshen
    Chen, Ling
    Hussain, Farookh
    Zhang, Chengqi
    [J]. WEB AND BIG DATA, APWEB-WAIM 2021, PT I, 2021, 12858 : 125 - 133
  • [45] Semi-supervised Anomaly Detection for Weakly-annotated Videos
    El-Tahan, Khaled
    Torki, Marwan
    [J]. PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 5, 2022, : 871 - 878
  • [46] Semi-supervised, Neural Network based approaches to face mask and anomaly detection in surveillance networks
    Saheel, Sabir
    Alvi, Anik
    Ani, Aninda Roy
    Ahmed, Tarem
    Uddin, Mohammad Faisal
    [J]. JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2024, 222
  • [47] Segmentation Improved Label Propagation for Semi-Supervised Anomaly Detection in Fused Magnesia Furnace Process
    Lu, Shaowen
    [J]. IEEE ACCESS, 2020, 8 : 219214 - 219222
  • [48] A SEMI-SUPERVISED MULTICLASS ANOMALY DETECTION APPROACH FOR PARTIALLY LABELED IN-PROCESS MEASUREMENT DATA
    Cohen, Joseph
    Ni, Jun
    [J]. PROCEEDINGS OF THE ASME 2021 16TH INTERNATIONAL MANUFACTURING SCIENCE AND ENGINEERING CONFERENCE (MSEC2021), VOL 2, 2021,
  • [49] Alternate methods for anomaly detection in high-energy physics via semi-supervised learning
    Ali, Mohd Adli Md
    Badrud'din, Nu'man
    Abdullah, Hafidzul
    Kemi, Faiz
    [J]. INTERNATIONAL JOURNAL OF MODERN PHYSICS A, 2020, 35 (23):
  • [50] Heterogeneous Anomaly Detection for Software Systems via Semi-supervised Cross-modal Attention
    Lee, Cheryl
    Yang, Tianyi
    Chen, Zhuangbin
    Su, Yuxin
    Yang, Yongqiang
    Lyu, Michael R.
    [J]. 2023 IEEE/ACM 45TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, ICSE, 2023, : 1724 - 1736