Semi-Supervised Anomaly Detection Via Neural Process

被引:8
|
作者
Zhou, Fan [1 ]
Wang, Guanyu [1 ]
Zhang, Kunpeng [2 ]
Liu, Siyuan [3 ]
Zhong, Ting [1 ,4 ]
机构
[1] Univ Elect Sci & Technol China, Chengdu 610054, Sichuan, Peoples R China
[2] Univ Maryland, Dept Decis Operat & Informat Technol, College Pk, MD 20742 USA
[3] Penn State Univ, Dept Supply Chain & Informat Syst, State Coll, PA 16802 USA
[4] Kashi Inst Elect & Informat Ind, Kashi 844199, Xinjiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; neural networks; neural process; probabilistic models; semi-supervised learning;
D O I
10.1109/TKDE.2023.3266755
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Many deep (semi-) supervised neural network-based methods have been proposed for anomaly detection, tackling the issue of limited labeled data. They have shown good performance but still face two major challenges. First, insufficient labeled data limits their flexibility. Second, measuring the uncertainty of the prediction, especially when dealing with objects deviating largely from training data, has not been well studied. Another common reason preventing them from prevailing is that they learn a determined function to make predictions from the input. This usually makes the predicted results uncertain and lacks robustness. To address these problems, we propose a novel framework, incorporating the neural process into the semi-supervised anomaly detection paradigm and efficiently using unlabeled data and a handful of labeled data in training. Different from other methods, ours is equivalent to modeling the distribution of functions representing anomalous patterns according to the labeled data rather than learning a single determined function for anomaly detection. Our approach improves the flexibility and robustness under the condition of insufficient training data, and can measure the uncertainty of prediction results. Extensive experiments under real-world datasets demonstrate that our proposed method can significantly improve anomaly detection performance compared to several cutting-edge benchmarks.
引用
收藏
页码:10423 / 10435
页数:13
相关论文
共 50 条
  • [31] Semi-supervised Log-based Anomaly Detection via Probabilistic Label Estimation
    Yang, Lin
    Chen, Junjie
    Wang, Zan
    Wang, Weijing
    Jiang, Jiajun
    Dong, Xuyuan
    Zhang, Wenbin
    [J]. 2021 IEEE/ACM 43RD INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2021), 2021, : 1448 - 1460
  • [32] Inductive Multi-View Semi-Supervised Anomaly Detection via Probabilistic Modeling
    Wang, Zhen
    Fan, Maohong
    Muknahallipatna, Suresh
    Lan, Chao
    [J]. 2019 10TH IEEE INTERNATIONAL CONFERENCE ON BIG KNOWLEDGE (ICBK 2019), 2019, : 257 - 264
  • [33] Phishing Web Page Detection with Semi-Supervised Deep Anomaly Detection
    Ouyang, Linshu
    Zhang, Yongzheng
    [J]. SECURITY AND PRIVACY IN COMMUNICATION NETWORKS, SECURECOMM 2021, PT II, 2021, 399 : 384 - 393
  • [34] MANomaly: Mutual adversarial networks for semi-supervised anomaly detection
    Zhang, Lianming
    Xie, Xiaowei
    Xiao, Kai
    Bai, Wenji
    Liu, Kui
    Dong, Pingping
    [J]. INFORMATION SCIENCES, 2022, 611 : 65 - 80
  • [35] SSCL: Semi-supervised Contrastive Learning for Industrial Anomaly Detection
    Cai, Wei
    Gao, Jiechao
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT IV, 2024, 14428 : 100 - 112
  • [36] PAC-Wrap: Semi-Supervised PAC Anomaly Detection
    Li, Shuo
    Ji, Xiayan
    Dobriban, Edgar
    Sokolsky, Oleg
    Lee, Insup
    [J]. PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 945 - 955
  • [37] Parameterless Semi-supervised Anomaly Detection in Univariate Time Series
    Iegorov, Oleg
    Fischmeister, Sebastian
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2020, PT I, 2021, 12457 : 644 - 659
  • [38] ConsE: Consistency Exploitation for Semi-Supervised Anomaly Detection in Graphs
    Chang, Wenjing
    Yu, Jianjun
    Zhou, Xiaojun
    [J]. 2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [39] Semi-supervised Graph Edge Convolutional Network for Anomaly Detection
    Lun, Zhicheng
    Gu, Xiaoyan
    Fan, Haihui
    Li, Bo
    Wang, Weiping
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT I, 2021, 12891 : 141 - 152
  • [40] Topological Learning for Semi-Supervised Anomaly Detection in Hyperspectral Imagery
    Ramirez, Juan, Jr.
    Armitage, Tristan
    Bihl, Trevor
    Kramer, Ryan
    [J]. PROCEEDINGS OF THE 2019 IEEE NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE (NAECON), 2019, : 560 - 564