Anomaly Detection on Attributed Networks via Contrastive Self-Supervised Learning

被引:169
|
作者
Liu, Yixin [1 ]
Li, Zhao [2 ]
Pan, Shirui [1 ]
Gong, Chen [3 ,4 ]
Zhou, Chuan [5 ]
Karypis, George [6 ]
机构
[1] Monash Univ, Fac Informat Technol, Dept Data Sci & AI, Clayton, Vic 3800, Australia
[2] Alibaba Grp, Hangzhou 310000, Peoples R China
[3] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Key Lab Intelligent Percept & Syst High Dimens In, PCA Lab,Minist Educ, Nanjing 210094, Peoples R China
[4] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Peoples R China
[5] Chinese Acad Sci, Acad Math & Syst Sci, Beijing 100093, Peoples R China
[6] Univ Minnesota, Dept Comp Sci & Engn, Minneapolis, MN 55455 USA
关键词
Anomaly detection; Task analysis; Graph neural networks; Unsupervised learning; Predictive models; Pattern matching; Training; attributed networks; contrastive self-supervised learning; graph neural networks (GNNs); unsupervised learning;
D O I
10.1109/TNNLS.2021.3068344
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anomaly detection on attributed networks attracts considerable research interests due to wide applications of attributed networks in modeling a wide range of complex systems. Recently, the deep learning-based anomaly detection methods have shown promising results over shallow approaches, especially on networks with high-dimensional attributes and complex structures. However, existing approaches, which employ graph autoencoder as their backbone, do not fully exploit the rich information of the network, resulting in suboptimal performance. Furthermore, these methods do not directly target anomaly detection in their learning objective and fail to scale to large networks due to the full graph training mechanism. To overcome these limitations, in this article, we present a novel Contrastive self-supervised Learning framework for Anomaly detection on attributed networks (CoLA for abbreviation). Our framework fully exploits the local information from network data by sampling a novel type of contrastive instance pair, which can capture the relationship between each node and its neighboring substructure in an unsupervised way. Meanwhile, a well-designed graph neural network (GNN)-based contrastive learning model is proposed to learn informative embedding from high-dimensional attributes and local structure and measure the agreement of each instance pairs with its outputted scores. The multiround predicted scores by the contrastive learning model are further used to evaluate the abnormality of each node with statistical estimation. In this way, the learning model is trained by a specific anomaly detection-aware target. Furthermore, since the input of the GNN module is batches of instance pairs instead of the full network, our framework can adapt to large networks flexibly. Experimental results show that our proposed framework outperforms the state-of-the-art baseline methods on all seven benchmark data sets.
引用
收藏
页码:2378 / 2392
页数:15
相关论文
共 50 条
  • [21] Contrastive self-supervised learning for diabetic retinopathy early detection
    Ouyang, Jihong
    Mao, Dong
    Guo, Zeqi
    Liu, Siguang
    Xu, Dong
    Wang, Wenting
    [J]. MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2023, 61 (09) : 2441 - 2452
  • [22] Contrastive Self-Supervised Learning for Globally Distributed Landslide Detection
    Ghorbanzadeh, Omid
    Shahabi, Hejar
    Piralilou, Sepideh Tavakkoli
    Crivellari, Alessandro
    La Rosa, Laura Elena Cue
    Atzberger, Clement
    Li, Jonathan
    Ghamisi, Pedram
    [J]. IEEE ACCESS, 2024, 12 : 118453 - 118466
  • [23] Contrastive self-supervised learning for diabetic retinopathy early detection
    Jihong Ouyang
    Dong Mao
    Zeqi Guo
    Siguang Liu
    Dong Xu
    Wenting Wang
    [J]. Medical & Biological Engineering & Computing, 2023, 61 : 2441 - 2452
  • [24] Multi-task Contrastive Learning for Anomaly Detection on Attributed Networks
    Zhang, Junjie
    Ding, Yuxin
    [J]. ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PT I, PAKDD 2024, 2024, 14645 : 15 - 26
  • [25] Shot Contrastive Self-Supervised Learning for Scene Boundary Detection
    Chen, Shixing
    Nie, Xiaohan
    Fan, David
    Zhang, Dongqing
    Bhat, Vimal
    Hamid, Raffay
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 9791 - 9800
  • [26] Missing nodes detection on graphs with self-supervised contrastive learning
    Liu, Chen
    Cao, Tingting
    Zhou, Lixin
    Shao, Ying
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 132
  • [27] Self-Supervised Contrastive Attributed Graph Joint Representation Clustering
    Wang, Jinghong
    Wang, Hui
    [J]. Computer Engineering and Applications, 2024, 60 (16) : 133 - 142
  • [28] Time-Contrastive Networks: Self-Supervised Learning from Video
    Sermanet, Pierre
    Lynch, Corey
    Chebotar, Yevgen
    Hsu, Jasmine
    Jang, Eric
    Schaal, Stefan
    Levine, Sergey
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, : 1134 - 1141
  • [29] Industrial Image Anomaly Detection via Self-Supervised Learning with Feature Enhancement Assistance
    Wu, Bin
    Wang, Xiaoqi
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (16):
  • [30] JOINT ANOMALY DETECTION AND INPAINTING FOR MICROSCOPY IMAGES VIA DEEP SELF-SUPERVISED LEARNING
    Huang, Ling
    Cheng, Deruo
    Yang, Xulei
    Lin, Tong
    Shi, Yiqiong
    Yang, Kaiyi
    Gwee, Bah Hwee
    Wen, Bihan
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3497 - 3501