Multidimensional time series classification with multiple attention mechanism

被引:0
|
作者
Chen Liu [1 ]
Zihan Wei [1 ]
Lixin Zhou [1 ]
Ying Shao [1 ]
机构
[1] University of Shanghai for Science and Technology,Business School
关键词
Multidimensional time series; Time series classification; Multiple attention; Deep learning;
D O I
10.1007/s40747-024-01630-w
中图分类号
学科分类号
摘要
The classification of multidimensional time series holds significant importance across various domains, including action classification, medical diagnosis, and credit assessment. Within multidimensional time series data, features pertinent to classification exhibit variance in their positional distribution along the entirety of the sequence. Moreover, the relative significance of features across distinct dimensions also fluctuates, contributing to suboptimal performance in multidimensional time series classification. Consequently, the proposition of tailored deep learning models for feature extraction specific to multidimensional time series data becomes imperative. This paper introduces attention mechanisms applied to the temporal dimension, graph attention mechanisms for inter-dimensional relationships within multidimensional data, and attention mechanisms applied between channels post-convolutional calculations. These mechanisms are deployed for feature extraction across temporal, variational, and channel dimensions of multidimensional time series data, respectively. Furthermore, attention is directed towards inter-channel interactions within the squeeze-and-excitation network to enhance the model’s representational capacity. Experimental findings substantiate the viability of integrating attention mechanisms into multidimensional time series classification endeavors.
引用
下载
收藏
相关论文
共 50 条
  • [1] Rethinking attention mechanism in time series classification
    Zhao, Bowen
    Xing, Huanlai
    Wang, Xinhan
    Song, Fuhong
    Xiao, Zhiwen
    INFORMATION SCIENCES, 2023, 627 : 97 - 114
  • [2] Heterogeneous Feature Based Time Series Classification With Attention Mechanism
    Zhang, Hanbo
    Wang, Peng
    Liang, Shen
    Zhou, Tongming
    Wang, Wei
    IEEE ACCESS, 2023, 11 : 19373 - 19384
  • [3] Multidimensional dynamic attention for multivariate time series forecasting
    Almaghrabi, Sarah
    Rana, Mashud
    Hamilton, Margaret
    Rahaman, Mohammad Saiedur
    Applied Soft Computing, 2024, 167
  • [4] Multivariate Time Series Early Classification with Interpretability Using Deep Learning and Attention Mechanism
    Hsu, En-Yu
    Liu, Chien-Liang
    Tseng, Vincent S.
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2019, PT III, 2019, 11441 : 541 - 553
  • [5] Remote Sensing Time Series Classification Based on Self-Attention Mechanism and Time Sequence Enhancement
    Liu, Jingwei
    Yan, Jining
    Wang, Lizhe
    Huang, Liang
    He, Haixu
    Liu, Hong
    REMOTE SENSING, 2021, 13 (09)
  • [6] Time Series Forecasting and Classification Models Based on Recurrent with Attention Mechanism and Generative Adversarial Networks
    Zhou, Kun
    Wang, Wenyong
    Hu, Teng
    Deng, Kai
    SENSORS, 2020, 20 (24) : 1 - 20
  • [7] Time series classification of remote sensing data based on temporal self-attention mechanism
    Zhang W.
    Tang P.
    Zhang Z.
    National Remote Sensing Bulletin, 2023, 27 (08) : 1914 - 1924
  • [8] Time Series Classification Method with Local Attention Enhancement
    Li, Kewen
    Ke, Cuihong
    Zhang, Min
    Wang, Xiaohui
    Geng, Wenliang
    Computer Engineering and Applications, 2024, 60 (01) : 189 - 197
  • [9] Time Series Classification on Edge with Lightweight Attention Networks
    Mukhopadhyay, Shalini
    Dey, Swarnava
    Mukherjee, Arijit
    Pal, Arpan
    Ashwin, S.
    2024 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS WORKSHOPS AND OTHER AFFILIATED EVENTS, PERCOM WORKSHOPS, 2024, : 487 - 492
  • [10] A New Attention Mechanism to Classify Multivariate Time Series
    Hao, Yifan
    Cao, Huiping
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 1999 - 2005