Multivariate Time Series Early Classification with Interpretability Using Deep Learning and Attention Mechanism

被引:19
|
作者
Hsu, En-Yu [1 ]
Liu, Chien-Liang [2 ]
Tseng, Vincent S. [1 ]
机构
[1] Natl Chiao Tung Univ, Dept Comp Sci, 1001 Univ Rd, Hsinchu 300, Taiwan
[2] Natl Chiao Tung Univ, Dept Ind Engn & Management, 1001 Univ Rd, Hsinchu 300, Taiwan
关键词
Early classification on time-series; Deep neural network; Attention; MODEL;
D O I
10.1007/978-3-030-16142-2_42
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multivariate time-series early classification is an emerging topic in data mining fields with wide applications like biomedicine, finance, manufacturing, etc. Despite of some recent studies on this topic that delivered promising developments, few relevant works can provide good interpretability. In this work, we consider simultaneously the important issues of model performance, earliness, and interpretability to propose a deep-learning framework based on the attention mechanism for multivariate time-series early classification. In the proposed model, we used a deep-learning method to extract the features among multiple variables and capture the temporal relation that exists in multivariate timeseries data. Additionally, the proposed method uses the attention mechanism to identify the critical segments related to model performance, providing a base to facilitate the better understanding of the model for further decision making. We conducted experiments on three real datasets and compared with several alternatives. While the proposed method can achieve comparable performance results and earliness compared to other alternatives, more importantly, it can provide interpretability by highlighting the important parts of the original data, rendering it easier for users to understand how the prediction is induced from the data.
引用
收藏
页码:541 / 553
页数:13
相关论文
共 50 条
  • [1] Benchmarking Attention-Based Interpretability of Deep Learning in Multivariate Time Series Predictions
    Baric, Domjan
    Fumic, Petar
    Horvatic, Davor
    Lipic, Tomislav
    [J]. ENTROPY, 2021, 23 (02) : 1 - 23
  • [2] Attention to Warp: Deep Metric Learning for Multivariate Time Series
    Matsuo, Shinnosuke
    Wu, Xiaomeng
    Atarsaikhan, Gantugs
    Kimura, Akisato
    Kashino, Kunio
    Iwana, Brian Kenji
    Uchida, Seiichi
    [J]. DOCUMENT ANALYSIS AND RECOGNITION, ICDAR 2021, PT III, 2021, 12823 : 350 - 365
  • [3] ST-Tree with interpretability for multivariate time series classification
    Du, Mingsen
    Wei, Yanxuan
    Tang, Yingxia
    Zheng, Xiangwei
    Wei, Shoushui
    Ji, Cun
    [J]. Neural Networks, 2025, 183
  • [4] Time-frequency deep metric learning for multivariate time series classification
    Chen, Zhi
    Liu, Yongguo
    Zhu, Jiajing
    Zhang, Yun
    Jin, Rongjiang
    He, Xia
    Tao, Jing
    Chen, Lidian
    [J]. NEUROCOMPUTING, 2021, 462 : 221 - 237
  • [5] Early classification on multivariate time series
    He, Guoliang
    Duan, Yong
    Peng, Rong
    Jing, Xiaoyuan
    Qian, Tieyun
    Wang, Lingling
    [J]. NEUROCOMPUTING, 2015, 149 : 777 - 787
  • [6] Multivariate Time Series Early Classification using Multi-Domain Deep Neural Network
    Huang, Huai-Shuo
    Liu, Chien-Liang
    Tseng, Vincent S.
    [J]. 2018 IEEE 5TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND ADVANCED ANALYTICS (DSAA), 2018, : 90 - 98
  • [7] A Deep Learning Architecture for Temporal Sleep Stage Classification Using Multivariate and Multimodal Time Series
    Chambon, Stanislas
    Galtier, Mathieu N.
    Arnal, Pierrick J.
    Wainrib, Gilles
    Gramfort, Alexandre
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2018, 26 (04) : 758 - 769
  • [8] Multivariate time-series classification of sleep patterns using a hybrid deep learning architecture
    Hong, Jeonghan
    Yoon, Junho
    [J]. 2017 IEEE 19TH INTERNATIONAL CONFERENCE ON E-HEALTH NETWORKING, APPLICATIONS AND SERVICES (HEALTHCOM), 2017,
  • [9] A deep reinforcement learning approach for early classification of time series
    Martinez, C.
    Perrin, G.
    Ramasso, E.
    Rombaut, M.
    [J]. 2018 26TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2018, : 2030 - 2034
  • [10] Clinical Interpretability of Deep Learning for Predicting Microvascular Invasion in Hepatocellular Carcinoma by Using Attention Mechanism
    You, Huayu
    Wang, Jifei
    Ma, Ruixia
    Chen, Yuying
    Li, Lujie
    Song, Chenyu
    Dong, Zhi
    Feng, Shiting
    Zhou, Xiaoqi
    [J]. BIOENGINEERING-BASEL, 2023, 10 (08):