Skip-patching spatial-temporal discrepancy-based anomaly detection on multivariate time series

被引:1
|
作者
Xu, Yinsong [1 ,2 ,3 ]
Ding, Yulong [1 ,3 ]
Jiang, Jie [4 ]
Cong, Runmin [5 ,6 ]
Zhang, Xuefeng [9 ]
Wang, Shiqi [2 ]
Kwong, Sam [7 ]
Yang, Shuang-Hua [3 ,8 ]
机构
[1] Southern Univ Sci & Technol, Dept Comp Sci & Engn, Shenzhen, Guangdong, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[3] Southern Univ Sci & Technol, Shenzhen Key Lab Safety & Secur Next Generat Ind I, Shenzhen, Guangdong, Peoples R China
[4] China Univ Petr, Coll Artificial Intelligence, Beijing, Peoples R China
[5] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[6] Minist Educ, Key Lab Machine Intelligence & Syst Control, Jinan, Peoples R China
[7] Lingnan Univ, Dept Comp & Decis Sci, Hong Kong, Peoples R China
[8] Univ Reading, Dept Comp Sci, Reading RG6 6AH, England
[9] Northeastern Univ, Coll Sci, Shenyang 110819, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; Industrial Internet of Things; Self-supervised learning; Multivariate time series; INTRUSION DETECTION;
D O I
10.1016/j.neucom.2024.128428
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anomaly detection in the Industrial Internet of Things (IIoT) is a challenging task that relies heavily on the efficient learning of multivariate time series representations. We introduce Skip-patching and Spatial- Temporal discrepancy mechanisms to improve the efficiency of detecting anomalies. Traditional feature extraction is hindered by redundant information in limited datasets. The situation is that feature generation from stable operational processes results in low-quality representations. To address this challenge, we propose the Skip-Patching mechanism. This approach involves selectively extracting features from partial data patches, prompting the model to learn more meaningful knowledge through self-supervised learning. It also effectively doubles the training sample size by creating independent sub-groups of patches. Despite the complex spatial and temporal relationships in IIoT systems, existing methods mainly extracted features from a single domain, either temporal or spatial (sensor-wise), or simply cascaded two features, i.e., one after one, which limited anomaly detection capabilities. To address this, we introduce the Spatial-Temporal Association Discrepancy component, which leverages discrepancies between spatial and temporal features to enhance latent representation learning. Our Skip-Patching Spatial-Temporal Anomaly Detection (SSAD) framework combines these two components to provide a more diverse and comprehensive learning process. Tested across four multivariate time series anomaly detection benchmarks, SSAD demonstrates superior performance, confirming the efficacy of combining Skip-patching and Spatial-Temporal features to enhance anomaly detection in IIoT systems.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Spatial-Temporal Dependency Based Multivariate Time Series Anomaly Detection for Industrial Processes
    Sun, Qi
    Li, Yahui
    Hu, Zhenpeng
    Zhou, Chunjie
    Liu, Lu
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT XIII, ICIC 2024, 2024, 14874 : 212 - 223
  • [2] Multivariate time series anomaly detection with variational autoencoder and spatial-temporal graph network
    Guan, Siwei
    He, Zhiwei
    Ma, Shenhui
    Gao, Mingyu
    COMPUTERS & SECURITY, 2024, 142
  • [3] Multivariate Time Series Anomaly Detection Based on Spatial-Temporal Network and Transformer in Industrial Internet of Things
    Zhao, Mengmeng
    Peng, Haipeng
    Li, Lixiang
    Ren, Yeqing
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 80 (02): : 2815 - 2837
  • [4] Spatial-temporal Attention Model Based on Transformer Architecture for Anomaly Detection in Multivariate Time Series Data
    Zeng, Lai
    Yang, Xiaomei
    Journal of Computers (Taiwan), 2024, 35 (03) : 193 - 207
  • [5] Dynamic-Static Fusion for Spatial-Temporal Anomaly Detection and Interpretation in Multivariate Time Series
    Ding, Guohui
    Zhu, Yueyi
    Ren, Yongqiang
    WEB AND BIG DATA, APWEB-WAIM 2024, PT III, 2024, 14963 : 46 - 61
  • [6] Correlation-Aware Spatial-Temporal Graph Learning for Multivariate Time-Series Anomaly Detection
    Zheng, Yu
    Koh, Huan Yee
    Jin, Ming
    Chi, Lianhua
    Phan, Khoa T.
    Pan, Shirui
    Chen, Yi-Ping Phoebe
    Xiang, Wei
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (09) : 11802 - 11816
  • [7] STGAT-MAD : SPATIAL-TEMPORAL GRAPH ATTENTION NETWORK FOR MULTIVARIATE TIME SERIES ANOMALY DETECTION
    Zhan, Jun
    Wang, Siqi
    Ma, Xiandong
    Wu, Chengkun
    Yang, Canqun
    Zeng, Detian
    Wang, Shilin
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 3568 - 3572
  • [8] Anomaly detection using spatial and temporal information in multivariate time series
    Tian, Zhiwen
    Zhuo, Ming
    Liu, Leyuan
    Chen, Junyi
    Zhou, Shijie
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [9] Anomaly detection using spatial and temporal information in multivariate time series
    Zhiwen Tian
    Ming Zhuo
    Leyuan Liu
    Junyi Chen
    Shijie Zhou
    Scientific Reports, 13
  • [10] Spatial-temporal graph convolutional networks foranomaly detection in multivariate time series
    Wang, Jing
    He, Miaomiao
    Ding, Jianli
    Li, Yonghua
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 51 (03): : 170 - 181