Adversarial Joint-Learning Recurrent Neural Network for Incomplete Time Series Classification

被引:33
|
作者
Ma, Qianli [1 ]
Li, Sen [1 ]
Cottrell, Garrison W. [2 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China
[2] Univ Calif San Diego, Dept Comp Sci & Engn, San Diego, CA 92093 USA
基金
中国国家自然科学基金;
关键词
Time series analysis; Recurrent neural networks; Data models; Training; Analytical models; Sensors; Computer science; Incomplete time series classification; recurrent neural networks; adversarial learning; exploding error; MODELS;
D O I
10.1109/TPAMI.2020.3027975
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Incomplete time series classification (ITSC) is an important issue in time series analysis since temporal data often has missing values in practical applications. However, integrating imputation (replacing missing data) and classification within a model often rapidly amplifies the error from imputed values. Reducing this error propagation from imputation to classification remains a challenge. To this end, we propose an adversarial joint-learning recurrent neural network (AJ-RNN) for ITSC, an end-to-end model trained in an adversarial and joint learning manner. We train the system to categorize the time series as well as impute missing values. To alleviate the error introduced by each imputation value, we use an adversarial network to encourage the network to impute realistic missing values by distinguishing real and imputed values. Hence, AJ-RNN can directly perform classification with missing values and greatly reduce the error propagation from imputation to classification, boosting the accuracy. Extensive experiments on 68 synthetic datasets and 4 real-world datasets from the expanded UCR time series archive demonstrate that AJ-RNN achieves state-of-the-art performance. Furthermore, we show that our model can effectively alleviate the accumulating error problem through qualitative and quantitative analysis based on the trajectory of the dynamical system learned by the RNN. We also provide an analysis of the model behavior to verify the effectiveness of our approach.
引用
收藏
页码:1765 / 1776
页数:12
相关论文
共 50 条
  • [1] Time series data classification using recurrent neural network with ensemble learning
    Oeda, Shinichi
    Kurimoto, Ikusaburo
    Ichimura, Takumi
    [J]. KNOWLEDGE-BASED INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS, PT 3, PROCEEDINGS, 2006, 4253 : 742 - 748
  • [2] Learning out of time series series with an extended recurrent neural network
    Schuster, M
    [J]. NEURAL NETWORKS FOR SIGNAL PROCESSING VI, 1996, : 170 - 179
  • [3] A Recurrent Neural Network based Generative Adversarial Network for Long Multivariate Time Series Forecasting
    Tang, Peiwang
    Zhang, Qinghua
    Zhang, Xianchao
    [J]. PROCEEDINGS OF THE 2023 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2023, 2023, : 181 - 189
  • [4] Recurrent neural networks for time series classification
    Hüsken, M
    Stagge, P
    [J]. NEUROCOMPUTING, 2003, 50 : 223 - 235
  • [5] A recurrent network implementation of time series classification
    Petridis, V
    Kehagias, A
    [J]. NEURAL COMPUTATION, 1996, 8 (02) : 357 - 372
  • [6] Hierarchical gated recurrent neural network with adversarial and virtual adversarial training on text classification
    Poon, Hoon-Keng
    Yap, Wun-She
    Tee, Yee-Kai
    Lee, Wai-Kong
    Goi, Bok-Min
    [J]. NEURAL NETWORKS, 2019, 119 : 299 - 312
  • [7] Relational Reinforcement Learning and Recurrent Neural Network with State Classification to Solve Joint Attention
    da Silva, Renato Ramos
    Francelin Romero, Roseli Aparecida
    [J]. 2011 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2011, : 1222 - 1229
  • [8] Adversarial Attacks on Deep Neural Networks for Time Series Classification
    Fawaz, Hassan Ismail
    Forestier, Germain
    Weber, Jonathan
    Idoumghar, Lhassane
    Muller, Pierre-Alain
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [9] Time Series Classification of Cryptocurrency Price Trend Based on a Recurrent LSTM Neural Network
    Kwon, Do-Hyung
    Kim, Ju-Bong
    Heo, Ju-Sung
    Kim, Chan-Myung
    Han, Youn-Hee
    [J]. JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2019, 15 (03): : 694 - 706
  • [10] Unsupervised multimodal domain adversarial network for time series classification
    Xi, Liang
    Liang, Yujia
    Huang, Xunhua
    Liu, Han
    Li, Ao
    [J]. INFORMATION SCIENCES, 2023, 624 : 147 - 164