An effective variational auto-encoder-based model for traffic flow imputation

被引:2
|
作者
Zhang, Shuo [1 ]
Hu, Xingbang [1 ]
Chen, Jinyi [1 ]
Zhang, Wenbo [1 ]
Huang, Hejiao [1 ,2 ]
机构
[1] Harbin Inst Technol, Dept Comp Sci & Technol, Shenzhen, Peoples R China
[2] Guangdong Prov Key Lab Novel Secur Intelligence Te, Shenzhen, Peoples R China
来源
NEURAL COMPUTING & APPLICATIONS | 2024年 / 36卷 / 05期
关键词
Variational auto-encoder; Traffic flow imputation; Intelligent transportation systems; NETWORKS; DETECTOR; TIME;
D O I
10.1007/s00521-023-09127-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Traffic flow imputation is crucial in modern intelligent transportation systems, due to frequent data missing caused by the failure of detectors or the influence of hostile external environment (e.g., signal strength). However, this work can be challenging for mainly three reasons: firstly, how to impute traffic flow that shows both universal complex spatio-temporal regularity and individual random authenticity is non-trivial. Secondly, though there are so many algorithms for traffic flow imputation, most of them either ignore different periodic dependencies or just deal with them independently. Lastly, the effectiveness of most deep learning models (etc., CNN, RNN) may be influenced by data missing in model training phase. To solve the problems above, an effective model traffic flow imputation variational auto-encoder (TFI-VAE) considering robust joint-periodic spatio-temporal features is proposed, which can impute missing value not only accurately but also realistically by introducing Gaussian mixture distribution enhanced VAE and normalization flows. Moreover, spatial missing oriented block and temporal missing oriented block are utilized in TFI-VAE to learn the spatial and temporal features of traffic flow data with ability to resist the negative effects of missing data. The experiments conducted on three real-world traffic flow datasets demonstrate that our TFI-VAE outperforms other classical imputation models from all aspects.
引用
收藏
页码:2617 / 2631
页数:15
相关论文
共 50 条
  • [1] An effective variational auto-encoder-based model for traffic flow imputation
    Shuo Zhang
    Xingbang Hu
    Jinyi Chen
    Wenbo Zhang
    Hejiao Huang
    Neural Computing and Applications, 2024, 36 : 2617 - 2631
  • [2] MIVAE: Multiple Imputation based on Variational Auto-Encoder
    Ma, Qian
    Li, Xia
    Bai, Mei
    Wang, Xite
    Ning, Bo
    Li, Guanyu
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 123
  • [3] Auto-encoder-based technique for effective detection of frauds in social networks
    Rani, S. Jamuna
    Vagdevi, S.
    INTERNATIONAL JOURNAL OF INFORMATION AND COMPUTER SECURITY, 2022, 18 (3-4) : 348 - 364
  • [4] Variational Auto-encoder-based Detection of Electricity Stealth Cyber-attacks in AMI Networks
    Takiddin, Abdulrahman
    Ismail, Muhammad
    Zafar, Usman
    Serpedin, Erchin
    28TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2020), 2021, : 1590 - 1594
  • [5] An auto-encoder-based summarization algorithm for unstructured videos
    Meng-Xiong Han
    Hai-Miao Hu
    Yang Liu
    Chi Zhang
    Rong-Peng Tian
    Jin Zheng
    Multimedia Tools and Applications, 2017, 76 : 25039 - 25056
  • [6] An auto-encoder-based summarization algorithm for unstructured videos
    Han, Meng-Xiong
    Hu, Hai-Miao
    Liu, Yang
    Zhang, Chi
    Tian, Rong-Peng
    Zheng, Jin
    MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (23) : 25039 - 25056
  • [7] Training Auto-Encoder-Based Optimizers for Terahertz Image Reconstruction
    Wong, Tak Ming
    Kahl, Matthias
    Haring-Bolivar, Peter
    Kolb, Andreas
    Moeller, Michael
    PATTERN RECOGNITION, DAGM GCPR 2019, 2019, 11824 : 93 - 106
  • [8] Stacked Auto-Encoder-Based Fault Location in Distribution Network
    Luo, Guomin
    Tan, Yingjie
    Li, Meng
    Cheng, Mengxiao
    Liu, Yanmei
    He, Jinghan
    IEEE ACCESS, 2020, 8 : 28043 - 28053
  • [9] Generalization error guaranteed auto-encoder-based nonlinear model reduction for operator learning
    Liu, Hao
    Dahal, Biraj
    Lai, Rongjie
    Liao, Wenjing
    APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2025, 74
  • [10] Deep Multiple Auto-Encoder-Based Multi-view Clustering
    Du, Guowang
    Zhou, Lihua
    Yang, Yudi
    Lu, Kevin
    Wang, Lizhen
    DATA SCIENCE AND ENGINEERING, 2021, 6 (03) : 323 - 338