Spatiotemporal subspace variational autoencoder with repair mechanism for traffic data imputation

被引:0
|
作者
Qian, Jialong [1 ]
Zhang, Shiqi [1 ]
Pian, Yuzhuang [1 ]
Chen, Xinyi [1 ]
Liu, Yonghong [1 ]
机构
[1] Sun Yat Sen Univ, Sch Intelligent Syst Engn, Shenzhen 510275, Guangdong, Peoples R China
基金
中国国家自然科学基金;
关键词
Spatiotemporal traffic data; Missing data imputation; Variational autoencoder; Spatiotemporal subspace; Graph neural networks;
D O I
10.1016/j.neucom.2024.128948
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High-quality spatial-temporal traffic data is crucial for the functioning of modern smart transportation systems. However, the collection and storage of traffic data in real-world scenarios are often hindered by many factors, causing data loss that greatly affects decision-making. Different modes of data absence result in varying degrees of information loss, which introduces considerable challenges to the precise imputation of traffic data. Many existing studies are concentrate on two main aspects: the examination of data distribution and the extraction of spatiotemporal relationships. On the one hand, methods that focus on distribution fitting do not require a large volume of observational data but often fail to capture spatial-temporal relationships, leading to overly smooth results. On the other hand, methods that aim to identify spatial-temporal relationships, while offering higher accuracy in fitting, demand a substantial amount of high-quality historical data. Taking into account the merits and demerits of both two paradigm, we developed a novel unsupervised two-stage model simultaneously takes into account the spatiotemporal distribution and relationships, termed Spatiotemporal Subspace Variational Autoencoder with Repair Mechanism (SVAE-R). In stage one, we introduced the concept of spatiotemporal subspace, which not only mitigates the noise impact caused by data sparsity but also reduces the cost for the model to find the distribution. In stage two, we designed a simple repair structure to capture spatial-temporal relationships among data through graph convolution network(GCN) and gated recurrent units(GRU), revising the details of the data. We have evaluated our model on two authentic datasets, and it has exhibited a high degree of robustness, maintaining effective performance even under extreme data loss conditions.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Variational AutoEncoder to Identify Anomalous Data in Robots
    Pangione, Luigi
    Burroughes, Guy
    Skilton, Robert
    ROBOTICS, 2021, 10 (03)
  • [42] A Variational Autoencoder for Heterogeneous Temporal and Longitudinal Data
    Ogretir, Mine
    Ramchandran, Siddharth
    Papatheodorou, Dimitrios
    Lahdesmaki, Harri
    2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 1522 - 1529
  • [43] Crash data augmentation using variational autoencoder
    Islam, Zubayer
    Abdel-Aty, Mohamed
    Cai, Qing
    Yuan, Jinghui
    ACCIDENT ANALYSIS AND PREVENTION, 2021, 151
  • [44] Missing Value Imputation Model Based on Adversarial Autoencoder Using Spatiotemporal Feature Extraction
    Shin, Dong-Hoon
    Lee, Seo-El
    Jeon, Byeong-Uk
    Chung, Kyungyong
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2023, 37 (02): : 1925 - 1940
  • [45] Fusing multimodal neuroimaging data with a variational autoencoder
    Geenjaar, Eloy
    Lewis, Noah
    Fu, Zening
    Venkatdas, Rohan
    Plis, Sergey
    Calhoun, Vince
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 3630 - 3633
  • [46] Multi-scale variational autoencoder for imputation of missing values in untargeted metabolomics using whole-genome sequencing data
    Zhao C.
    Su K.-J.
    Wu C.
    Cao X.
    Sha Q.
    Li W.
    Luo Z.
    Qing T.
    Qiu C.
    Zhao L.J.
    Liu A.
    Jiang L.
    Zhang X.
    Shen H.
    Zhou W.
    Deng H.-W.
    Computers in Biology and Medicine, 2024, 179
  • [47] Spatiotemporal Imputation of Traffic Emissions With Self-Supervised Diffusion Model
    Pei, Lihong
    Cao, Yang
    Kang, Yu
    Xu, Zhenyi
    Liu, Qianming
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [48] Subspace Learning and Imputation for Streaming Big Data Matrices and Tensors
    Mardani, Morteza
    Mateos, Gonzalo
    Giannakis, Georgios B.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2015, 63 (10) : 2663 - 2677
  • [49] A General Spatiotemporal Imputation Framework for Missing Sensor Data
    Tharzeen, Aahila
    Munikoti, Sai
    Prakash, Punit
    Kim, Jungkwun
    Natarajan, Balasubramaniam
    2023 IEEE CONFERENCE ON ARTIFICIAL INTELLIGENCE, CAI, 2023, : 55 - 58
  • [50] Spatiotemporal trajectories in resting-state FMRI revealed by convolutional variational autoencoder
    Zhang, Xiaodi
    Maltbie, Eric A.
    Keilholz, Shella D.
    NEUROIMAGE, 2021, 244