Tucker factorization-based tensor completion for robust traffic data imputation

被引:1
|
作者
Lyu, Cheng [1 ]
Lu, Qing-Long [1 ]
Wu, Xinhua [2 ]
Antoniou, Constantinos [1 ]
机构
[1] Tech Univ Munich, Chair Transportat Syst Engn, Munich, Germany
[2] Northeastern Univ, Dept Civil Environm Engn, Boston, MA USA
关键词
Tensor completion; Tucker factorization; Data imputation; Changepoint detection; Bregman ADMM; MISSING DATA; ALGORITHM; L(1)-MINIMIZATION;
D O I
10.1016/j.trc.2024.104502
中图分类号
U [交通运输];
学科分类号
08 ; 0823 ;
摘要
Missing values are prevalent in spatio-temporal traffic data, undermining the quality of datadriven analysis. While prior works have demonstrated the promise of tensor completion methods for imputation, their performance remains limited for complicated composite missing patterns. This paper proposes a novel imputation framework combining tensor factorization and rank minimization, which is effective in capturing key traffic dynamics and eliminates the need for exhaustive rank tuning. The framework is further supplemented with time series decomposition to account for trends, spatio-temporal correlations, and outliers, with the intention of improving the robustness of imputation results. A Bregman ADMM algorithm is designed to solve the resulting multi -block nonconvex optimization efficiently. Experiments on four real -world traffic state datasets suggest that the proposed framework outperforms state-of-the-art imputation methods, including the context of complex missing patterns with high missing rates, while maintaining reasonable computation efficiency. Furthermore, the robustness of our model in extreme missing data scenarios, as well as under perturbation in hyperparameters, has been validated. These results also underscore the potential benefits of incorporating temporal modeling for more reliable imputation.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] Traffic data imputation via tensor completion based on soft thresholding of Tucker core
    Goulart, J. H. de M.
    Kibangou, A. Y.
    Favier, G.
    [J]. TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2017, 85 : 348 - 362
  • [2] Traffic Speed Data Imputation Method Based on Tensor Completion
    Ran, Bin
    Tan, Huachun
    Feng, Jianshuai
    Liu, Ying
    Wang, Wuhong
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2015, 2015
  • [3] Tensor Factorization-Based Method for Tensor Completion with Spatio-temporal Characterization
    Quan Yu
    Xinzhen Zhang
    Zheng-Hai Huang
    [J]. Journal of Optimization Theory and Applications, 2023, 199 : 337 - 362
  • [4] Tensor Factorization-Based Method for Tensor Completion with Spatio-temporal Characterization
    Yu, Quan
    Zhang, Xinzhen
    Huang, Zheng-Hai
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2023, 199 (01) : 337 - 362
  • [5] TuckER: Tensor Factorization for Knowledge Graph Completion
    Balazevic, Ivana
    Allen, Carl
    Hospedales, Timothy M.
    [J]. 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019): PROCEEDINGS OF THE CONFERENCE, 2019, : 5185 - 5194
  • [6] TENSOR FACTORIZATION WITH TOTAL VARIATION FOR INTERNET TRAFFIC DATA IMPUTATION
    Yu, Gaohang
    Wang, Liqin
    Wan, Shaochun
    Qi, Liqun
    Xu, Yanwei
    [J]. PACIFIC JOURNAL OF OPTIMIZATION, 2021, 17 (03): : 486 - 505
  • [7] Graph Spectral Regularized Tensor Completion for Traffic Data Imputation
    Deng, Lei
    Liu, Xiao-Yang
    Zheng, Haifeng
    Feng, Xinxin
    Chen, Youjia
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (08) : 10996 - 11010
  • [8] Tucker factorization with missing data with application to low--rank tensor completion
    Filipovic, Marko
    Jukic, Ante
    [J]. MULTIDIMENSIONAL SYSTEMS AND SIGNAL PROCESSING, 2015, 26 (03) : 677 - 692
  • [9] Fast Tucker Factorization for Large-Scale Tensor Completion
    Lee, Dongha
    Lee, Jaehyung
    Yu, Hwanjo
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2018, : 1098 - 1103
  • [10] A Multi-Attention Tensor Completion Network for Spatiotemporal Traffic Data Imputation
    Wu, Xuesong
    Xu, Mengyun
    Fang, Jie
    Wu, Xiongwei
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (20) : 20203 - 20213