Semi-Supervised Anomaly Detection Via Neural Process

被引:8
|
作者
Zhou, Fan [1 ]
Wang, Guanyu [1 ]
Zhang, Kunpeng [2 ]
Liu, Siyuan [3 ]
Zhong, Ting [1 ,4 ]
机构
[1] Univ Elect Sci & Technol China, Chengdu 610054, Sichuan, Peoples R China
[2] Univ Maryland, Dept Decis Operat & Informat Technol, College Pk, MD 20742 USA
[3] Penn State Univ, Dept Supply Chain & Informat Syst, State Coll, PA 16802 USA
[4] Kashi Inst Elect & Informat Ind, Kashi 844199, Xinjiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; neural networks; neural process; probabilistic models; semi-supervised learning;
D O I
10.1109/TKDE.2023.3266755
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many deep (semi-) supervised neural network-based methods have been proposed for anomaly detection, tackling the issue of limited labeled data. They have shown good performance but still face two major challenges. First, insufficient labeled data limits their flexibility. Second, measuring the uncertainty of the prediction, especially when dealing with objects deviating largely from training data, has not been well studied. Another common reason preventing them from prevailing is that they learn a determined function to make predictions from the input. This usually makes the predicted results uncertain and lacks robustness. To address these problems, we propose a novel framework, incorporating the neural process into the semi-supervised anomaly detection paradigm and efficiently using unlabeled data and a handful of labeled data in training. Different from other methods, ours is equivalent to modeling the distribution of functions representing anomalous patterns according to the labeled data rather than learning a single determined function for anomaly detection. Our approach improves the flexibility and robustness under the condition of insufficient training data, and can measure the uncertainty of prediction results. Extensive experiments under real-world datasets demonstrate that our proposed method can significantly improve anomaly detection performance compared to several cutting-edge benchmarks.
引用
收藏
页码:10423 / 10435
页数:13
相关论文
共 50 条
  • [1] GANomaly: Semi-supervised Anomaly Detection via Adversarial Training
    Akcay, Samet
    Atapour-Abarghouei, Amir
    Breckon, Toby P.
    [J]. COMPUTER VISION - ACCV 2018, PT III, 2019, 11363 : 622 - 637
  • [2] Boosting Semi-Supervised Anomaly Detection via Contrasting Synthetic Images
    Yu, Sheng-Feng
    Chiu, Wei-Chen
    [J]. PROCEEDINGS OF 17TH INTERNATIONAL CONFERENCE ON MACHINE VISION APPLICATIONS (MVA 2021), 2021,
  • [3] ANOMALY DETECTION IN AERIAL IMAGES VIA SEMI-SUPERVISED ADVERSARIAL TRAINING
    Yu, Chih-Chang
    Wang, Pu-Hsin
    Cheng, Hsu-Yung
    [J]. 2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 5035 - 5038
  • [4] Semi-Supervised Anomaly Detection with Contrastive Regularization
    Jezequel, Loic
    Vu, Ngoc-Son
    Beaudet, Jean
    Histace, Aymeric
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 2664 - 2671
  • [5] Semi-supervised Anomaly Detection with Reinforcement Learning
    Lee, Changheon
    Kim, JoonKyu
    Kang, Suk-Ju
    [J]. 2022 37TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC 2022), 2022, : 933 - 936
  • [6] Semi-supervised Anomaly Detection on Attributed Graphs
    Kumagai, Atsutoshi
    Iwata, Tomoharu
    Fujiwara, Yasuhiro
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [7] An Efficient Semi-Supervised SVM for Anomaly Detection
    Kim, Junae
    Montague, Paul
    [J]. 2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 2843 - 2850
  • [8] Semi-Supervised Isolation Forest for Anomaly Detection
    Stradiotti, Luca
    Perini, Lorenzo
    Davis, Jesse
    [J]. PROCEEDINGS OF THE 2024 SIAM INTERNATIONAL CONFERENCE ON DATA MINING, SDM, 2024, : 670 - 678
  • [9] Comparison of Semi-supervised Deep Neural Networks for Anomaly Detection in Industrial Processes
    Chadha, Gavneet Singh
    Rabbani, Arfyan
    Schwung, Andreas
    [J]. 2019 IEEE 17TH INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS (INDIN), 2019, : 214 - 219
  • [10] Statistical approaches for semi-supervised anomaly detection in machining
    Denkena, B.
    Dittrich, M-A
    Noske, H.
    Witt, M.
    [J]. PRODUCTION ENGINEERING-RESEARCH AND DEVELOPMENT, 2020, 14 (03): : 385 - 393