Gap imputation in related multivariate time series through recurrent neural network-based denoising autoencoder

被引:2
|
作者
Alonso, Serafin [1 ]
Moran, Antonio [1 ]
Perez, Daniel [1 ]
Prada, Miguel A. [1 ]
Fuertes, Juan J. [1 ]
Dominguez, Manuel [1 ]
机构
[1] Univ Leon, Grp Invest Supervis Control & Automatizac Proc In, Esc Ingn Ind Informat & Aeroespacial, Campus Vegazana S-N, Leon 24007, Spain
关键词
Sensor observations; missing data; gap imputation; multivariate time series; denoising autoencoder; recurrent neural network; MISSING DATA; LOAD; MODEL; REPRESENTATIONS; AE;
D O I
10.3233/ICA-230728
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Technological advances in industry have made it possible to install many connected sensors, generating a great amount of observations at high rate. The advent of Industry 4.0 requires analysis capabilities of heterogeneous data in form of related multivariate time series. However, missing data can degrade processing and lead to bias and misunderstandings or even wrong decision-making. In this paper, a recurrent neural network-based denoising autoencoder is proposed for gap imputation in related multivariate time series, i.e., series that exhibit spatio-temporal correlations. The denoising autoencoder (DAE) is able to reproduce input missing data by learning to remove intentionally added gaps, while the recurrent neural network (RNN) captures temporal patterns and relationships among variables. For that reason, different unidirectional (simple RNN, GRU, LSTM) and bidirectional (BiSRNN, BiGRU, BiLSTM) architectures are compared with each other and to state-of-the-art methods using three different datasets in the experiments. The implementation with BiGRU layers outperforms the others, effectively filling gaps with a low reconstruction error. The use of this approach is appropriate for complex scenarios where several variables contain long gaps. However, extreme scenarios with very short gaps in one variable or no available data should be avoided.
引用
收藏
页码:157 / 172
页数:16
相关论文
共 50 条
  • [1] Multivariate Time Series Missing Data Imputation Using Recurrent Denoising Autoencoder
    Zhang, Jianye
    Yin, Peng
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2019, : 760 - 764
  • [2] Multivariate Time Series as Images: Imputation Using Convolutional Denoising Autoencoder
    Al Safi, Abdullah
    Beyer, Christian
    Unnikrishnan, Vishnu
    Spiliopoulou, Myra
    [J]. ADVANCES IN INTELLIGENT DATA ANALYSIS XVIII, IDA 2020, 2020, 12080 : 1 - 13
  • [3] Recurrent Neural Network-Based Autoencoder for Problems of Automatic Time Series Analysis at Power Facilities
    Matrenin, P., V
    Khalyasmaa, A., I
    Potachits, Y. V.
    [J]. PROBLEMELE ENERGETICII REGIONALE, 2023, (02): : 61 - 71
  • [4] Graph Neural Network-Based Anomaly Detection in Multivariate Time Series
    Deng, Ailin
    Hooi, Bryan
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 4027 - 4035
  • [5] Deep recurrent neural network-based autoencoder for photoplethysmogram artifacts filtering
    Azar, Joseph
    Makhoul, Abdallah
    Couturier, Raphael
    Demerjian, Jacques
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2021, 92
  • [6] Robust Anomaly Detection for Multivariate Time Series through Stochastic Recurrent Neural Network
    Su, Ya
    Zhao, Youjian
    Niu, Chenhao
    Liu, Rong
    Sun, Wei
    Pei, Dan
    [J]. KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, : 2828 - 2837
  • [7] Recurrent Imputation for Multivariate Time Series with Missing Values
    Suo, Qiuling
    Yao, Liuyi
    Xun, Guangxu
    Sun, Jianhui
    Zhang, Aidong
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON HEALTHCARE INFORMATICS (ICHI), 2019, : 562 - 564
  • [8] Network-Based Segmentation of Biological Multivariate Time Series
    Omranian, Nooshin
    Klie, Sebastian
    Mueller-Roeber, Bernd
    Nikoloski, Zoran
    [J]. PLOS ONE, 2013, 8 (05):
  • [9] A Recurrent Neural Network based Generative Adversarial Network for Long Multivariate Time Series Forecasting
    Tang, Peiwang
    Zhang, Qinghua
    Zhang, Xianchao
    [J]. PROCEEDINGS OF THE 2023 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, ICMR 2023, 2023, : 181 - 189
  • [10] Neural network-based analysis of MR time series
    Fischer, H
    Hennig, J
    [J]. MAGNETIC RESONANCE IN MEDICINE, 1999, 41 (01) : 124 - 131