Beyond Sharing: Conflict-Aware Multivariate Time Series Anomaly Detection

被引:1
|
作者
Si, Haotian [5 ]
Pei, Changhua [1 ]
Li, Zhihan [2 ]
Zhao, Yadong [1 ]
Li, Jingjing [1 ]
Zhang, Haiming [1 ]
Diao, Zulong [3 ,6 ]
Li, Jianhui [1 ]
Xie, Gaogang [1 ]
Pei, Dan [4 ]
机构
[1] Chinese Acad Sci, Comp Network Informat Ctr, Beijing, Peoples R China
[2] Kuaishou Technol, Beijing, Peoples R China
[3] Chinese Acad Sci, Inst Comp Technol, Beijing, Peoples R China
[4] Tsinghua Univ, Beijing, Peoples R China
[5] Univ Chinese Acad Sci, Beijing, Peoples R China
[6] Purple Mt Labs, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Unsupervised Anomaly Detection; Multivariate Time Series;
D O I
10.1145/3611643.3613896
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Massive key performance indicators (KPIs) are monitored as multivariate time series data (MTS) to ensure the reliability of the software applications and service system. Accurately detecting the abnormality of MTS is very critical for subsequent fault elimination. The scarcity of anomalies and manual labeling has led to the development of various self-supervised MTS anomaly detection (AD) methods, which optimize an overall objective/loss encompassing all metrics' regression objectives/losses. However, our empirical study uncovers the prevalence of conflicts among metrics' regression objectives, causing MTS models to grapple with different losses. This critical aspect significantly impacts detection performance but has been overlooked in existing approaches. To address this problem, by mimicking the design of multi-gate mixture-of-experts (MMoE), we introduce CAD, a Conflict-aware multivariate KPI Anomaly Detection algorithm. CAD offers an exclusive structure for each metric to mitigate potential conflicts while fostering inter-metric promotions. Upon thorough investigation, we find that the poor performance of vanilla MMoE mainly comes from the input-output misalignment settings of MTS formulation and convergence issues arising from expansive tasks. To address these challenges, we propose a straightforward yet effective task-oriented metric selection and p&s (personalized and shared) gating mechanism, which establishes CAD as the first practicable multi-task learning (MTL) based MTS AD model. Evaluations on multiple public datasets reveal that CAD obtains an average F1-score of 0.943 across three public datasets, notably outperforming state-of-the-art methods. Our code is accessible at https://github.com/dawnvince/MTS_CAD
引用
收藏
页码:1635 / 1645
页数:11
相关论文
共 50 条
  • [41] Multivariate time series anomaly detection: A framework of Hidden Markov Models
    Li, Jinbo
    Pedrycz, Witold
    Jamal, Iqbal
    APPLIED SOFT COMPUTING, 2017, 60 : 229 - 240
  • [42] Adversarial Graph Neural Network for Multivariate Time Series Anomaly Detection
    Zheng, Bolong
    Ming, Lingfeng
    Zeng, Kai
    Zhou, Mengtao
    Zhang, Xinyong
    Ye, Tao
    Yang, Bin
    Zhou, Xiaofang
    Jensen, Christian S.
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (12) : 7612 - 7626
  • [43] Anomaly detection using spatial and temporal information in multivariate time series
    Tian, Zhiwen
    Zhuo, Ming
    Liu, Leyuan
    Chen, Junyi
    Zhou, Shijie
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [44] Clustering-based anomaly detection in multivariate time series data
    Li, Jinbo
    Izakian, Hesam
    Pedrycz, Witold
    Jamal, Iqbal
    APPLIED SOFT COMPUTING, 2021, 100
  • [45] Semisupervised anomaly detection of multivariate time series based on a variational autoencoder
    Ningjiang Chen
    Huan Tu
    Xiaoyan Duan
    Liangqing Hu
    Chengxiang Guo
    Applied Intelligence, 2023, 53 : 6074 - 6098
  • [46] Anomaly Detection for Multivariate Time Series Based on Contrastive Learning and Autoformer
    Shang, Xuwen
    Zhang, Jue
    Jiang, Xingguo
    Luo, Hong
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 2614 - 2619
  • [47] Joint Subsequence Anomaly Detection and Fault Classification for Multivariate Time Series
    Li, Rui
    Sun, Ningyuan
    Zheng, Hongyun
    Chen, Yishuai
    2024 9TH INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATION SYSTEMS, ICCCS 2024, 2024, : 143 - 148
  • [48] A Multivariate Time Series Anomaly Detection Method Based on Generative Model
    Chen, Shaowei
    Xu, Fangda
    Wen, Pengfei
    Feng, Shuaiwen
    Zhao, Shuai
    2022 IEEE INTERNATIONAL CONFERENCE ON PROGNOSTICS AND HEALTH MANAGEMENT (ICPHM), 2022, : 137 - 144
  • [49] Fine-Grained Multivariate Time Series Anomaly Detection in IoT
    He, Shiming
    Guo, Meng
    Yang, Bo
    Alfarraj, Osama
    Tolba, Amr
    Sharma, Pradip Kumar
    Yan, Xi'ai
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 75 (03): : 5027 - 5047
  • [50] Clustering-based anomaly detection in multivariate time series data
    Li, Jinbo
    Izakian, Hesam
    Pedrycz, Witold
    Jamal, Iqbal
    Applied Soft Computing, 2021, 100