Spatiotemporal subspace variational autoencoder with repair mechanism for traffic data imputation

被引:0
|
作者
Qian, Jialong [1 ]
Zhang, Shiqi [1 ]
Pian, Yuzhuang [1 ]
Chen, Xinyi [1 ]
Liu, Yonghong [1 ]
机构
[1] Sun Yat Sen Univ, Sch Intelligent Syst Engn, Shenzhen 510275, Guangdong, Peoples R China
基金
中国国家自然科学基金;
关键词
Spatiotemporal traffic data; Missing data imputation; Variational autoencoder; Spatiotemporal subspace; Graph neural networks;
D O I
10.1016/j.neucom.2024.128948
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High-quality spatial-temporal traffic data is crucial for the functioning of modern smart transportation systems. However, the collection and storage of traffic data in real-world scenarios are often hindered by many factors, causing data loss that greatly affects decision-making. Different modes of data absence result in varying degrees of information loss, which introduces considerable challenges to the precise imputation of traffic data. Many existing studies are concentrate on two main aspects: the examination of data distribution and the extraction of spatiotemporal relationships. On the one hand, methods that focus on distribution fitting do not require a large volume of observational data but often fail to capture spatial-temporal relationships, leading to overly smooth results. On the other hand, methods that aim to identify spatial-temporal relationships, while offering higher accuracy in fitting, demand a substantial amount of high-quality historical data. Taking into account the merits and demerits of both two paradigm, we developed a novel unsupervised two-stage model simultaneously takes into account the spatiotemporal distribution and relationships, termed Spatiotemporal Subspace Variational Autoencoder with Repair Mechanism (SVAE-R). In stage one, we introduced the concept of spatiotemporal subspace, which not only mitigates the noise impact caused by data sparsity but also reduces the cost for the model to find the distribution. In stage two, we designed a simple repair structure to capture spatial-temporal relationships among data through graph convolution network(GCN) and gated recurrent units(GRU), revising the details of the data. We have evaluated our model on two authentic datasets, and it has exhibited a high degree of robustness, maintaining effective performance even under extreme data loss conditions.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] MISSING DATA IN TRAFFIC ESTIMATION: A VARIATIONAL AUTOENCODER IMPUTATION METHOD
    Boquet, Guillem
    Lopez Vicario, Jose
    Morell, Antoni
    Serrano, Javier
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 2882 - 2886
  • [2] Traffic Data Imputation with Ensemble Convolutional Autoencoder
    Ye, Yongchao
    Zhang, Shuyu
    Yu, James J. Q.
    2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 1340 - 1345
  • [3] Spatiotemporal traffic data imputation by synergizing low tensor ring rank and nonlocal subspace regularization
    Wu, Peng-Ling
    Ding, Meng
    Zheng, Yu-Bang
    IET INTELLIGENT TRANSPORT SYSTEMS, 2023, 17 (09) : 1908 - 1923
  • [4] Imputation of Missing Values in Training Data using Variational Autoencoder
    Hong, Xuerui
    Hao, Shuang
    2023 IEEE 39TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOPS, ICDEW, 2023, : 49 - 54
  • [5] A spatiotemporal approach for traffic data imputation with complicated missing patterns
    Li, Huiping
    Li, Meng
    Lin, Xi
    He, Fang
    Wang, Yinhai
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2020, 119
  • [6] A Kriging based spatiotemporal approach for traffic volume data imputation
    Yang, Hongtai
    Yang, Jianjiang
    Han, Lee D.
    Liu, Xiaohan
    Pu, Li
    Chin, Shih-miao
    Hwang, Ho-ling
    PLOS ONE, 2018, 13 (04):
  • [7] A Bayesian tensor decomposition approach for spatiotemporal traffic data imputation
    Chen, Xinyu
    He, Zhaocheng
    Sun, Lijun
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2019, 98 : 73 - 84
  • [8] A variational autoencoder solution for road traffic forecasting systems: Missing data imputation, dimension reduction, model selection and anomaly detection
    Boquet, Guillem
    Morell, Antoni
    Serrano, Javier
    Lopez Vicario, Jose
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2020, 115
  • [9] A Hybrid Data-Driven Framework for Spatiotemporal Traffic Flow Data Imputation
    Wang, Peixiao
    Hu, Tao
    Gao, Fei
    Wu, Ruijie
    Guo, Wei
    Zhu, Xinyan
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (17) : 16343 - 16352
  • [10] Analysis of Spatiotemporal Data Imputation Methods for Traffic Flow Data in Urban Networks
    Joelianto, Endra
    Fathurrahman, Muhammad Farhan
    Sutarto, Herman Yoseph
    Semanjski, Ivana
    Putri, Adiyana
    Gautama, Sidharta
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2022, 11 (05)