Gap imputation in related multivariate time series through recurrent neural network-based denoising autoencoder

被引:2
|
作者
Alonso, Serafin [1 ]
Moran, Antonio [1 ]
Perez, Daniel [1 ]
Prada, Miguel A. [1 ]
Fuertes, Juan J. [1 ]
Dominguez, Manuel [1 ]
机构
[1] Univ Leon, Grp Invest Supervis Control & Automatizac Proc In, Esc Ingn Ind Informat & Aeroespacial, Campus Vegazana S-N, Leon 24007, Spain
关键词
Sensor observations; missing data; gap imputation; multivariate time series; denoising autoencoder; recurrent neural network; MISSING DATA; LOAD; MODEL; REPRESENTATIONS; AE;
D O I
10.3233/ICA-230728
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Technological advances in industry have made it possible to install many connected sensors, generating a great amount of observations at high rate. The advent of Industry 4.0 requires analysis capabilities of heterogeneous data in form of related multivariate time series. However, missing data can degrade processing and lead to bias and misunderstandings or even wrong decision-making. In this paper, a recurrent neural network-based denoising autoencoder is proposed for gap imputation in related multivariate time series, i.e., series that exhibit spatio-temporal correlations. The denoising autoencoder (DAE) is able to reproduce input missing data by learning to remove intentionally added gaps, while the recurrent neural network (RNN) captures temporal patterns and relationships among variables. For that reason, different unidirectional (simple RNN, GRU, LSTM) and bidirectional (BiSRNN, BiGRU, BiLSTM) architectures are compared with each other and to state-of-the-art methods using three different datasets in the experiments. The implementation with BiGRU layers outperforms the others, effectively filling gaps with a low reconstruction error. The use of this approach is appropriate for complex scenarios where several variables contain long gaps. However, extreme scenarios with very short gaps in one variable or no available data should be avoided.
引用
收藏
页码:157 / 172
页数:16
相关论文
共 50 条
  • [41] Analysis and modeling of multivariate chaotic time series based on neural network
    Han, M.
    Wang, Y.
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2009, 36 (02) : 1280 - 1290
  • [42] Deep neural network-based bottleneck feature and denoising autoencoder-based dereverberation for distant-talking speaker identification
    Zhang, Zhaofeng
    Wang, Longbiao
    Kai, Atsuhiko
    Yamada, Takanori
    Li, Weifeng
    Iwahashi, Masahiro
    [J]. EURASIP JOURNAL ON AUDIO SPEECH AND MUSIC PROCESSING, 2015,
  • [43] DDANF: Deep denoising autoencoder normalizing flow for unsupervised multivariate time series anomaly detection
    Zhao, Xigang
    Liu, Peng
    Mahmoudi, Said
    Garg, Sahil
    Kaddoum, Georges
    Hassan, Mohammad Mehedi
    [J]. ALEXANDRIA ENGINEERING JOURNAL, 2024, 108 : 436 - 444
  • [44] DAS-GNN: Denoising autoencoder integrated with self-supervised learning in graph neural network-based recommendations
    Dai, Jiuqian
    Yuan, Weihua
    Bao, Chen
    Zhang, Zhijun
    [J]. APPLIED INTELLIGENCE, 2023, 53 (14) : 17292 - 17309
  • [45] DAS-GNN: Denoising autoencoder integrated with self-supervised learning in graph neural network-based recommendations
    Jiuqian Dai
    Weihua Yuan
    Chen Bao
    Zhijun Zhang
    [J]. Applied Intelligence, 2023, 53 : 17292 - 17309
  • [46] Unsupervised Anomaly Detection in Multivariate Time Series through Transformer-based Variational Autoencoder
    Zhang, Hongwei
    Xia, Yuanqing
    Yan, Tijin
    Liu, Guiyang
    [J]. PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 281 - 286
  • [47] Neural Network-Based Active Learning in Multivariate Calibration
    Ukil, Abhisek
    Bernasconi, Jakob
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2012, 42 (06): : 1763 - 1771
  • [48] Dynamic Sign Language Recognition Based on CBAM with Autoencoder Time Series Neural Network
    Huang, Yanglai
    Huang, Jing
    Wu, Xiaoyue
    Jia, Yu
    [J]. MOBILE INFORMATION SYSTEMS, 2022, 2022
  • [49] Recurrent Neural Networks for Multivariate Time Series with Missing Values
    Che, Zhengping
    Purushotham, Sanjay
    Cho, Kyunghyun
    Sontag, David
    Liu, Yan
    [J]. SCIENTIFIC REPORTS, 2018, 8
  • [50] Recurrent Neural Networks for Multivariate Time Series with Missing Values
    Zhengping Che
    Sanjay Purushotham
    Kyunghyun Cho
    David Sontag
    Yan Liu
    [J]. Scientific Reports, 8