Missing traffic data imputation and pattern discovery with a Bayesian augmented tensor factorization model

被引:92
|
作者
Chen, Xinyu [1 ]
He, Zhaocheng [1 ]
Chen, Yixian [1 ]
Lu, Yuhuan [1 ]
Wang, Jiawei [1 ,2 ]
机构
[1] Sun Yat Sen Univ, Res Ctr Intelligent Transportat Syst, Guangdong Prov Key Lab Intelligent Transportat Sy, Guangzhou 510006, Guangdong, Peoples R China
[2] Shenzhen Cyberspace Lab, Peng Cheng Lab, Shenzhen 518000, Guangdong, Peoples R China
基金
中国国家自然科学基金;
关键词
Spatiotemporal traffic data; Missing data imputation; Pattern discovery; Bayesian tensor factorization; Variational Bayes; MATRIX; FLOW;
D O I
10.1016/j.trc.2019.03.003
中图分类号
U [交通运输];
学科分类号
08 ; 0823 ;
摘要
Spatiotemporal traffic data, which represent multidimensional time series on considering different spatial locations, are ubiquitous in real-world transportation systems. However, the inevitable missing data problem makes data-driven intelligent transportation systems suffer from an incorrect response. Therefore, imputing missing values is of great importance but challenging as it is not easy to capture spatiotemporal traffic patterns, including explicit and latent features. In this study, we propose an augmented tensor factorization model by incorporating generic forms of domain knowledge from transportation systems. Specifically, we present a fully Bayesian framework for automatically learning parameters of this model using variational Bayes (VB). Relying on the publicly available urban traffic speed data set collected in Guangzhou, China, experiments on two types of missing data scenarios (i.e., random and non-random) demonstrate that the proposed Bayesian augmented tensor factorization (BATF) model achieves best imputation accuracies and outperforms the state-of-the-art baselines (e.g., Bayesian tensor factorization models). Besides, we discover interpretable patterns from the experimentally learned global parameter, biases, and latent factors that indeed conform to the dynamic of traffic states.
引用
收藏
页码:66 / 77
页数:12
相关论文
共 50 条
  • [1] Simultaneous Incomplete Traffic Data Imputation and Similarity Pattern Discovery with Bayesian Nonparametric Tensor Decomposition
    Han, Yaxiong
    He, Zhaocheng
    [J]. JOURNAL OF ADVANCED TRANSPORTATION, 2020, 2020 : 1DUMMMY
  • [2] TENSOR FACTORIZATION FOR MISSING DATA IMPUTATION IN MEDICAL QUESTIONNAIRES
    Dauwels, Justin
    Garg, Lalit
    Earnest, Arul
    Pang, Leong Khai
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 2109 - 2112
  • [3] TENSOR FACTORIZATION WITH TOTAL VARIATION FOR INTERNET TRAFFIC DATA IMPUTATION
    Yu, Gaohang
    Wang, Liqin
    Wan, Shaochun
    Qi, Liqun
    Xu, Yanwei
    [J]. PACIFIC JOURNAL OF OPTIMIZATION, 2021, 17 (03): : 486 - 505
  • [4] Missing data imputation for traffic congestion data based on joint matrix factorization
    Jia, Xiaoyi
    Dong, Xiaoyu
    Chen, Meng
    Yu, Xiaohui
    [J]. KNOWLEDGE-BASED SYSTEMS, 2021, 225
  • [5] A Bayesian tensor decomposition approach for spatiotemporal traffic data imputation
    Chen, Xinyu
    He, Zhaocheng
    Sun, Lijun
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2019, 98 : 73 - 84
  • [6] Bayesian Kernelized Matrix Factorization for Spatiotemporal Traffic Data Imputation and Kriging
    Lei, Mengying
    Labbe, Aurelie
    Wu, Yuankai
    Sun, Lijun
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) : 18962 - 18974
  • [7] BAYESIAN IMPUTATION FOR MISSING DATA
    Nads, Azman A.
    Polestico, Daisy Lou L.
    [J]. ADVANCES AND APPLICATIONS IN STATISTICS, 2022, 79 : 83 - 104
  • [8] Augmented Stochastic Multiple Imputation Model for Airport Pavement Missing Data Imputation
    Farhan, J.
    Fwa, T. F.
    [J]. TRANSPORTATION RESEARCH RECORD, 2014, (2449) : 96 - 104
  • [9] A Bayesian robust CP decomposition approach for missing traffic data imputation
    Zhu, Yun
    Wang, Weiye
    Yu, Gaohang
    Wang, Jun
    Tang, Lei
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (23) : 33171 - 33184
  • [10] Tucker factorization-based tensor completion for robust traffic data imputation
    Lyu, Cheng
    Lu, Qing-Long
    Wu, Xinhua
    Antoniou, Constantinos
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2024, 160