Spatiotemporal subspace variational autoencoder with repair mechanism for traffic data imputation

被引:0
|
作者
Qian, Jialong [1 ]
Zhang, Shiqi [1 ]
Pian, Yuzhuang [1 ]
Chen, Xinyi [1 ]
Liu, Yonghong [1 ]
机构
[1] Sun Yat Sen Univ, Sch Intelligent Syst Engn, Shenzhen 510275, Guangdong, Peoples R China
基金
中国国家自然科学基金;
关键词
Spatiotemporal traffic data; Missing data imputation; Variational autoencoder; Spatiotemporal subspace; Graph neural networks;
D O I
10.1016/j.neucom.2024.128948
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High-quality spatial-temporal traffic data is crucial for the functioning of modern smart transportation systems. However, the collection and storage of traffic data in real-world scenarios are often hindered by many factors, causing data loss that greatly affects decision-making. Different modes of data absence result in varying degrees of information loss, which introduces considerable challenges to the precise imputation of traffic data. Many existing studies are concentrate on two main aspects: the examination of data distribution and the extraction of spatiotemporal relationships. On the one hand, methods that focus on distribution fitting do not require a large volume of observational data but often fail to capture spatial-temporal relationships, leading to overly smooth results. On the other hand, methods that aim to identify spatial-temporal relationships, while offering higher accuracy in fitting, demand a substantial amount of high-quality historical data. Taking into account the merits and demerits of both two paradigm, we developed a novel unsupervised two-stage model simultaneously takes into account the spatiotemporal distribution and relationships, termed Spatiotemporal Subspace Variational Autoencoder with Repair Mechanism (SVAE-R). In stage one, we introduced the concept of spatiotemporal subspace, which not only mitigates the noise impact caused by data sparsity but also reduces the cost for the model to find the distribution. In stage two, we designed a simple repair structure to capture spatial-temporal relationships among data through graph convolution network(GCN) and gated recurrent units(GRU), revising the details of the data. We have evaluated our model on two authentic datasets, and it has exhibited a high degree of robustness, maintaining effective performance even under extreme data loss conditions.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] A Novel Spatiotemporal Data Low-Rank Imputation Approach for Traffic Sensor Network
    Chen, Xiaobo
    Liang, Shurong
    Zhang, Zhihao
    Zhao, Feng
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (20): : 20122 - 20135
  • [22] A nonconvex low-rank tensor completion model for spatiotemporal traffic data imputation
    Chen, Xinyu
    Yang, Jinming
    Sun, Lijun
    Transportation Research Part C: Emerging Technologies, 2020, 117
  • [23] Spatiotemporal Tensor Completion for Improved Urban Traffic Imputation
    Ben Said, Ahmed
    Erradi, Abdelkarim
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) : 6836 - 6849
  • [24] Variational AutoEncoder for synthetic insurance data
    Jamotton, Charlotte
    Hainaut, Donatien
    INTELLIGENT SYSTEMS WITH APPLICATIONS, 2024, 24
  • [25] Functional Subspace Variational Autoencoder for Domain-Adaptive Fault Diagnosis
    Li, Tan
    Fung, Che-Heng
    Wong, Him-Ting
    Chan, Tak-Lam
    Hu, Haibo
    MATHEMATICS, 2023, 11 (13)
  • [26] A Bayesian tensor ring decomposition model with automatic rank determination for spatiotemporal traffic data imputation
    Liu, Mengxia
    Lyu, Hao
    Ge, Hongxia
    Cheng, Rongjun
    APPLIED MATHEMATICAL MODELLING, 2025, 137
  • [27] Spatiotemporal traffic data imputation via tensorial weighted Schatten-p norm minimization
    Wang, Shaofan
    Zhao, Yongbo
    Zhang, Yong
    Hu, Yongli
    Yin, Baocai
    IET INTELLIGENT TRANSPORT SYSTEMS, 2022, 16 (07) : 926 - 939
  • [28] A Traffic Flow Data Quality Repair Model Based on Spatiotemporal Correlation
    Li, Yan
    Xu, Liangjie
    Qin, Wendie
    Xie, Cong
    Ji, Chuanwang
    IEEE ACCESS, 2024, 12 : 116816 - 116828
  • [29] Siamese Autoencoder Architecture for the Imputation of Data Missing Not at Random
    Pereira, Ricardo Cardoso
    Abreu, Pedro Henriques
    Rodrigues, Pedro Pereira
    JOURNAL OF COMPUTATIONAL SCIENCE, 2024, 78
  • [30] Masked Autoencoder Transformer for Missing Data Imputation of PISA
    Freire, Guilherme Mendonca
    Curi, Mariana
    ARTIFICIAL INTELLIGENCE IN EDUCATION: POSTERS AND LATE BREAKING RESULTS, WORKSHOPS AND TUTORIALS, INDUSTRY AND INNOVATION TRACKS, PRACTITIONERS, DOCTORAL CONSORTIUM AND BLUE SKY, AIED 2024, PT I, 2024, 2150 : 364 - 372