Skip-patching spatial-temporal discrepancy-based anomaly detection on multivariate time series

被引:1
|
作者
Xu, Yinsong [1 ,2 ,3 ]
Ding, Yulong [1 ,3 ]
Jiang, Jie [4 ]
Cong, Runmin [5 ,6 ]
Zhang, Xuefeng [9 ]
Wang, Shiqi [2 ]
Kwong, Sam [7 ]
Yang, Shuang-Hua [3 ,8 ]
机构
[1] Southern Univ Sci & Technol, Dept Comp Sci & Engn, Shenzhen, Guangdong, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[3] Southern Univ Sci & Technol, Shenzhen Key Lab Safety & Secur Next Generat Ind I, Shenzhen, Guangdong, Peoples R China
[4] China Univ Petr, Coll Artificial Intelligence, Beijing, Peoples R China
[5] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[6] Minist Educ, Key Lab Machine Intelligence & Syst Control, Jinan, Peoples R China
[7] Lingnan Univ, Dept Comp & Decis Sci, Hong Kong, Peoples R China
[8] Univ Reading, Dept Comp Sci, Reading RG6 6AH, England
[9] Northeastern Univ, Coll Sci, Shenyang 110819, Peoples R China
基金
中国国家自然科学基金;
关键词
Anomaly detection; Industrial Internet of Things; Self-supervised learning; Multivariate time series; INTRUSION DETECTION;
D O I
10.1016/j.neucom.2024.128428
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anomaly detection in the Industrial Internet of Things (IIoT) is a challenging task that relies heavily on the efficient learning of multivariate time series representations. We introduce Skip-patching and Spatial- Temporal discrepancy mechanisms to improve the efficiency of detecting anomalies. Traditional feature extraction is hindered by redundant information in limited datasets. The situation is that feature generation from stable operational processes results in low-quality representations. To address this challenge, we propose the Skip-Patching mechanism. This approach involves selectively extracting features from partial data patches, prompting the model to learn more meaningful knowledge through self-supervised learning. It also effectively doubles the training sample size by creating independent sub-groups of patches. Despite the complex spatial and temporal relationships in IIoT systems, existing methods mainly extracted features from a single domain, either temporal or spatial (sensor-wise), or simply cascaded two features, i.e., one after one, which limited anomaly detection capabilities. To address this, we introduce the Spatial-Temporal Association Discrepancy component, which leverages discrepancies between spatial and temporal features to enhance latent representation learning. Our Skip-Patching Spatial-Temporal Anomaly Detection (SSAD) framework combines these two components to provide a more diverse and comprehensive learning process. Tested across four multivariate time series anomaly detection benchmarks, SSAD demonstrates superior performance, confirming the efficacy of combining Skip-patching and Spatial-Temporal features to enhance anomaly detection in IIoT systems.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] An anomaly detection model for multivariate time series with anomaly perception
    Wei, Dong
    Sun, Wu
    Zou, Xiaofeng
    Ma, Dan
    Xu, Huarong
    Chen, Panfeng
    Yang, Chaoshu
    Chen, Mei
    Li, Hui
    PEERJ COMPUTER SCIENCE, 2024, 10
  • [42] A novel spatial-temporal graph convolution network based on temporal embedding graph structure learning for multivariate time series prediction
    Lei, Tianyang
    Li, Jichao
    Yang, Kewei
    Gong, Chang
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 141
  • [43] An anomaly detection model for multivariate time series with anomaly perception
    Wei, Dong
    Sun, Wu
    Zou, Xiaofeng
    Ma, Dan
    Xu, Huarong
    Chen, Panfeng
    Yang, Chaoshu
    Chen, Mei
    Li, Hui
    PeerJ Computer Science, 2024, 10
  • [44] Anomaly Detection based on Robust Spatial-temporal Modeling for Industrial Control Systems
    Li, Shijie
    Liu, Junjiao
    Pan, Zhiwen
    Lv, Shichao
    Si, Shuaizong
    Sun, Limin
    2022 IEEE 19TH INTERNATIONAL CONFERENCE ON MOBILE AD HOC AND SMART SYSTEMS (MASS 2022), 2022, : 355 - 363
  • [45] STL: Online Detection of Taxi Trajectory Anomaly Based on Spatial-Temporal Laws
    Cheng, Bin
    Qian, Shiyou
    Cao, Jian
    Xue, Guangtao
    Yu, Jiadi
    Zhu, Yanmin
    Li, Minglu
    Zhang, Tao
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2019), PT II, 2019, 11447 : 764 - 779
  • [46] Spatial-temporal trajectory anomaly detection based on an improved spectral clustering algorithm
    Guo, Yishan
    Liu, Mandan
    INTELLIGENT DATA ANALYSIS, 2023, 27 (01) : 31 - 58
  • [47] A time series anomaly detection method based on series-parallel transformers with spatial and temporal association discrepancies
    Fu, Shiyuan
    Gao, Xin
    Zhai, Feng
    Li, Baofeng
    Xue, Bing
    Yu, Jiahao
    Meng, Zhihang
    Zhang, Guangyao
    INFORMATION SCIENCES, 2024, 657
  • [48] Multivariate Time Series Anomaly Detection with Fourier Time Series Transformer
    Ye, Yufeng
    He, Qichao
    Zhang, Peng
    Xiao, Jie
    Li, Zhao
    2023 IEEE 12TH INTERNATIONAL CONFERENCE ON CLOUD NETWORKING, CLOUDNET, 2023, : 381 - 388
  • [49] Discrepancy-Based Theory and Algorithms for Forecasting Non-Stationary Time Series
    Kuznetsov, Vitaly
    Mohri, Mehryar
    ANNALS OF MATHEMATICS AND ARTIFICIAL INTELLIGENCE, 2020, 88 (04) : 367 - 399
  • [50] Anomaly detection model for multivariate time series based on stochastic Transformer
    Huo W.
    Liang R.
    Li Y.
    Tongxin Xuebao/Journal on Communications, 2023, 44 (02): : 94 - 103