Anomaly Detection Based on GCNs and DBSCAN in a Large-Scale Graph

被引:0
|
作者
Emane, Christopher Retiti Diop [1 ]
Song, Sangho [1 ]
Lee, Hyeonbyeong [1 ]
Choi, Dojin [2 ]
Lim, Jongtae [1 ]
Bok, Kyoungsoo [3 ]
Yoo, Jaesoo [1 ]
机构
[1] Chungbuk Natl Univ, Dept Informat & Commun Engn, Chungdae ro 1, Cheongju 28644, South Korea
[2] Changwon Natl Univ, Dept Comp Engn, Changwondaehak ro 20, Chang Won 51140, South Korea
[3] Wonkwang Univ, Dept Artificial Intelligence Convergence, Iksandae 460, Iksan 54538, South Korea
基金
新加坡国家研究基金会;
关键词
anomaly detection; GCNs; DBSCAN; deep learning; clustering algorithms; large-scale graph;
D O I
10.3390/electronics13132625
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Anomaly detection is critical across domains, from cybersecurity to fraud prevention. Graphs, adept at modeling intricate relationships, offer a flexible framework for capturing complex data structures. This paper proposes a novel anomaly detection approach, combining Graph Convolutional Networks (GCNs) and Density-Based Spatial Clustering of Applications with Noise (DBSCAN). GCNs, a specialized deep learning model for graph data, extracts meaningful node and edge representations by incorporating graph topology and attribute information. This facilitates learning expressive node embeddings capturing local and global structural patterns. For anomaly detection, DBSCAN, a density-based clustering algorithm effective in identifying clusters of varying densities amidst noise, is employed. By defining a minimum distance threshold and a minimum number of points within that distance, DBSCAN proficiently distinguishes normal graph elements from anomalies. Our approach involves training a GCN model on a labeled graph dataset, generating appropriately labeled node embeddings. These embeddings serve as input to DBSCAN, identifying clusters and isolating anomalies as noise points. The evaluation on benchmark datasets highlights the superior performance of our approach in anomaly detection compared to traditional methods. The fusion of GCNs and DBSCAN demonstrates a significant potential for accurate and efficient anomaly detection in graphs. This research contributes to advancing graph-based anomaly detection, with promising applications in domains where safeguarding data integrity and security is paramount.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Probabilistic Temporal Fusion Transformers for Large-Scale KPI Anomaly Detection
    Luo, Haoran
    Zheng, Yongkun
    Chen, Kang
    Zhao, Shuo
    IEEE ACCESS, 2024, 12 : 9123 - 9137
  • [42] Hierarchical Anomaly Detection and Multimodal Classification in Large-Scale Photovoltaic Systems
    Zhao, Yingying
    Liu, Qi
    Li, Dongsheng
    Kang, Dahai
    Lv, Qin
    Shang, Li
    IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2019, 10 (03) : 1351 - 1361
  • [43] Expected similarity estimation for large-scale batch and streaming anomaly detection
    Markus Schneider
    Wolfgang Ertel
    Fabio Ramos
    Machine Learning, 2016, 105 : 305 - 333
  • [44] Large-Scale Traffic Anomaly Detection: Analysis of Real Netflow Datasets
    Spognardi, Angelo
    Villani, Antonio
    Vitali, Domenico
    Mancini, Luigi Vincenzo
    Battistoni, Roberto
    E-BUSINESS AND TELECOMMUNICATIONS, ICETE 2012, 2014, 455 : 192 - 208
  • [45] Efficient and Robust Trace Anomaly Detection for Large-Scale Microservice Systems
    Zhang, Shenglin
    Pan, Zhongjie
    Liu, Heng
    Jin, Pengxiang
    Sun, Yongqian
    Ouyang, Qianyu
    Wang, Jiaju
    Jia, Xueying
    Zhang, Yuzhi
    Yang, Hui
    Zou, Yongqiang
    Pei, Dan
    2023 IEEE 34TH INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING, ISSRE, 2023, : 69 - 79
  • [46] A Large-scale Replication of Smart Grids Power Consumption Anomaly Detection
    Rossi, Bruno
    PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON INTERNET OF THINGS, BIG DATA AND SECURITY (IOTBDS), 2020, : 288 - 295
  • [47] Adaptive Label Propagation for Group Anomaly Detection in Large-Scale Networks
    Li, Zhao
    Chen, Xia
    Song, Junshuai
    Gao, Jun
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (12) : 12053 - 12067
  • [48] Higher-Order PCA for Anomaly Detection in Large-Scale Networks
    Kim, Hayang
    Lee, Sungeun
    Ma, Xiaoli
    Wang, Chao
    2009 3RD IEEE INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING (CAMSAP 2009), 2009, : 85 - 88
  • [49] Performance Anomaly and Change Point Detection For Large-Scale System Management
    Trubin, Igor
    ICPE'20: COMPANION OF THE ACM/SPEC INTERNATIONAL CONFERENCE ON PERFORMANCE ENGINEERING, 2020, : 7 - 7
  • [50] Generative and Autoencoder Models for Large-Scale Mutivariate Unsupervised Anomaly Detection
    Ounassera, Nabila
    Rhanoui, Maryem
    Mikram, Mounia
    El Asri, Bouchra
    NETWORKING, INTELLIGENT SYSTEMS AND SECURITY, 2022, 237 : 45 - 58