Attention-Based Deep Gated Fully Convolutional End-to-End Architectures for Time Series Classification

被引:0
|
作者
Mehak Khan
Hongzhi Wang
Alladoumbaye Ngueilbaye
机构
[1] Harbin Institute of Technology,School of Computer Science and Technology
来源
Neural Processing Letters | 2021年 / 53卷
关键词
Attention mechanism; Convolutional neural network; Squeeze-and-excitation; Gated recurrent unit; Univariate time series classification; Multivariate time series classification;
D O I
暂无
中图分类号
学科分类号
摘要
Time series classification (TSC) is one of the significant problems in the data mining community due to the wide class of domains involving the time series data. The TSC problem is being studied individually for univariate and multivariate using different datasets and methods. Subsequently, deep learning methods are more robust than other techniques and revolutionized many areas, including TSC. Therefore, in this study, we exploit the performance of attention mechanism, deep Gated Recurrent Unit (dGRU), Squeeze-and-Excitation (SE) block, and Fully Convolutional Network (FCN) in two end-to-end hybrid deep learning architectures, Att-dGRU-FCN and Att-dGRU-SE-FCN. The performance of the proposed models is evaluated in terms of classification testing error and f1-score. Extensive experiments and ablation study is carried out on multiple univariate and multivariate datasets from different domains to acquire the best performance of the proposed models. The proposed models show effective performance over other published methods, also do not require heavy data pre-processing, and small enough to be deployed on real-time systems.
引用
收藏
页码:1995 / 2028
页数:33
相关论文
共 50 条
  • [1] Attention-Based Deep Gated Fully Convolutional End-to-End Architectures for Time Series Classification
    Khan, Mehak
    Wang, Hongzhi
    Ngueilbaye, Alladoumbaye
    [J]. NEURAL PROCESSING LETTERS, 2021, 53 (03) : 1995 - 2028
  • [2] End-to-end multivariate time series classification via hybrid deep learning architectures
    Khan, Mehak
    Wang, Hongzhi
    Ngueilbaye, Alladoumbaye
    Elfatyany, Aya
    [J]. PERSONAL AND UBIQUITOUS COMPUTING, 2020, 27 (2) : 177 - 191
  • [3] End-to-end multivariate time series classification via hybrid deep learning architectures
    Mehak Khan
    Hongzhi Wang
    Alladoumbaye Ngueilbaye
    Aya Elfatyany
    [J]. Personal and Ubiquitous Computing, 2023, 27 : 177 - 191
  • [4] Assessing Knee OA Severity with CNN attention-based end-to-end architectures
    Gorriz, Marc
    Antony, Joseph
    McGuinness, Kevin
    Giro-i-Nieto, Xavier
    O'Connor, Noel E.
    [J]. INTERNATIONAL CONFERENCE ON MEDICAL IMAGING WITH DEEP LEARNING, VOL 102, 2019, 102 : 197 - 214
  • [5] Using Deep Gated RNN with a Convolutional Front End for End-to-End Classification of Heart Sound
    Thomae, Christian
    Dominik, Andreas
    [J]. 2016 COMPUTING IN CARDIOLOGY CONFERENCE (CINC), VOL 43, 2016, 43 : 625 - 628
  • [6] Attention-based end-to-end image defogging network
    Yang, Yan
    Zhang, Chen
    Jiang, Peipei
    Yue, Hui
    [J]. ELECTRONICS LETTERS, 2020, 56 (15) : 759 - +
  • [7] Attention-based neural network for end-to-end music separation
    Wang, Jing
    Liu, Hanyue
    Ying, Haorong
    Qiu, Chuhan
    Li, Jingxin
    Anwar, Muhammad Shahid
    [J]. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2023, 8 (02) : 355 - 363
  • [8] END-TO-END ATTENTION-BASED LARGE VOCABULARY SPEECH RECOGNITION
    Bandanau, Dzmitry
    Chorowski, Jan
    Serdyuk, Dmitriy
    Brakel, Philemon
    Bengio, Yoshua
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 4945 - 4949
  • [9] Speaker Adaptation for Attention-Based End-to-End Speech Recognition
    Meng, Zhong
    Gaur, Yashesh
    Li, Jinyu
    Gong, Yifan
    [J]. INTERSPEECH 2019, 2019, : 241 - 245
  • [10] ATTENTION-BASED END-TO-END SPEECH RECOGNITION ON VOICE SEARCH
    Shan, Changhao
    Zhang, Junbo
    Wang, Yujun
    Xie, Lei
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 4764 - 4768