Log Anomaly Detection Based on Hierarchical Graph Neural Network and Label Contrastive Coding

被引:2
|
作者
Fang, Yong [1 ]
Zhao, Zhiying [1 ]
Xu, Yijia [1 ]
Liu, Zhonglin [1 ]
机构
[1] Sichuan Univ, Sch Cyber Sci & Engn, Chengdu 610000, Peoples R China
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2023年 / 74卷 / 02期
基金
中国国家自然科学基金;
关键词
Log analysis; anomaly detection; contrastive learning; graph neural network;
D O I
10.32604/cmc.2023.033124
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
System logs are essential for detecting anomalies, querying faults, and tracing attacks. Because of the time-consuming and labor-intensive nature of manual system troubleshooting and anomaly detection, it cannot meet the actual needs. The implementation of automated log anomaly detection is a topic that demands urgent research. However, the prior work on processing log data is mainly one-dimensional and cannot profoundly learn the complex associations in log data. Meanwhile, there is a lack of attention to the utilization of log labels and usually relies on a large number of labels for detection. This paper proposes a novel and practical detection model named LCC-HGLog, the core of which is the conversion of log anomaly detection into a graph classification problem. Semantic temporal graphs (STG) are constructed by extracting the raw logs' execution sequences and template semantics. Then a unique graph classifier is used to better comprehend each STG's semantic, sequential, and structural features. The classification model is trained jointly by graph classification loss and label contrastive loss. While achieving discriminability at the class-level, it increases the fine-grained identification at the instance-level, thus achieving detection performance even with a small amount of labeled data. We have conducted numerous experiments on real log datasets, showing that the proposed model outperforms the baseline methods and obtains the best all-around performance. Moreover, the detection performance degrades to less than 1% when only 10% of the labeled data is used. With 200 labeled samples, we can achieve the same or better detection results than the baseline methods.
引用
收藏
页码:4099 / 4118
页数:20
相关论文
共 50 条
  • [1] Label Contrastive Coding Based Graph Neural Network for Graph Classification
    Ren, Yuxiang
    Bai, Jiyang
    Zhang, Jiawei
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2021), PT I, 2021, 12681 : 123 - 140
  • [2] GCCAD: Graph Contrastive Coding for Anomaly Detection
    Chen, Bo
    Zhang, Jing
    Zhang, Xiaokang
    Dong, Yuxiao
    Song, Jian
    Zhang, Peng
    Xu, Kaibo
    Kharlamov, Evgeny
    Tang, Jie
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (08) : 8037 - 8051
  • [3] Reinforced Contrastive Graph Neural Networks (RCGNN) for Anomaly Detection
    Sun, Zenan
    Su, Jingyi
    Jeon, Donghyun
    Velasquez, Alvaro
    Song, Houbing
    Niu, Shuteng
    [J]. 2022 IEEE INTERNATIONAL PERFORMANCE, COMPUTING, AND COMMUNICATIONS CONFERENCE, IPCCC, 2022,
  • [4] Hierarchical Contrastive Learning Enhanced Heterogeneous Graph Neural Network
    Liu N.
    Wang X.
    Han H.
    Shi C.
    [J]. IEEE Transactions on Knowledge and Data Engineering, 2023, 35 (10) : 10884 - 10896
  • [5] Anomaly detection of traffic session based on graph neural network
    Du Peng
    Peng Cheng-Wei
    Xiang Peng
    Li Qing-Shan
    [J]. PROCEEDINGS OF THE 2022 INTERNATIONAL CONFERENCE ON CYBER SECURITY, CSW 2022, 2022, : 1 - 9
  • [6] Graph Neural Network Based Anomaly Detection in Dynamic Networks
    Guo J.-Y.
    Li R.-H.
    Zhang Y.
    Wang G.-R.
    [J]. Ruan Jian Xue Bao/Journal of Software, 2020, 31 (03): : 748 - 762
  • [7] Online Anomaly Detection of Wind Turbines Based on Hierarchical Spatio-temporal Graph Neural Network
    Zheng Y.
    Wang C.
    Liu B.
    Yang J.
    Huang C.
    [J]. Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2024, 48 (05): : 107 - 119
  • [8] GCC: Graph Contrastive Coding for Graph Neural Network Pre-Training
    Qiu, Jiezhong
    Chen, Qibin
    Dong, Yuxiao
    Zhang, Jing
    Yang, Hongxia
    Ding, Ming
    Wang, Kuansan
    Tang, Jie
    [J]. KDD '20: PROCEEDINGS OF THE 26TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2020, : 1150 - 1160
  • [9] Network Anomaly Detection Using a Graph Neural Network
    Kisanga, Patrice
    Woungang, Isaac
    Traore, Issa
    Carvalho, Glaucio H. S.
    [J]. 2023 INTERNATIONAL CONFERENCE ON COMPUTING, NETWORKING AND COMMUNICATIONS, ICNC, 2023, : 61 - 65
  • [10] A Hierarchical Spatio-Temporal Graph Convolutional Neural Network for Anomaly Detection in Videos
    Zeng, Xianlin
    Jiang, Yalong
    Ding, Wenrui
    Li, Hongguang
    Hao, Yafeng
    Qiu, Zifeng
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (01) : 200 - 212