Bayesian Temporal Factorization for Multidimensional Time Series Prediction

被引:126
|
作者
Chen, Xinyu [1 ]
Sun, Lijun [2 ,3 ]
机构
[1] Polytech Montreal, Dept Civil Geol & Min Engn, Montreal, PQ H3T 1J4, Canada
[2] McGill Univ, Dept Civil Engn, Montreal, PQ H3A 0C3, Canada
[3] Interuniv Res Ctr Enterprise Networks Logist & Tr, Montreal, PQ H3T 1J4, Canada
基金
加拿大创新基金会; 加拿大自然科学与工程研究理事会;
关键词
Time series analysis; Data models; Bayes methods; Spatiotemporal phenomena; Tensors; Reactive power; Probabilistic logic; Time series prediction; missing data imputation; low rank; matrix; tensor factorization; vector autoregression (VAR); Bayesian inference; Markov chain Monte Carlo (MCMC); DECOMPOSITION; MODELS;
D O I
10.1109/TPAMI.2021.3066551
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Large-scale and multidimensional spatiotemporal data sets are becoming ubiquitous in many real-world applications such as monitoring urban traffic and air quality. Making predictions on these time series has become a critical challenge due to not only the large-scale and high-dimensional nature but also the considerable amount of missing data. In this paper, we propose a Bayesian temporal factorization (BTF) framework for modeling multidimensional time series-in particular spatiotemporal data-in the presence of missing values. By integrating low-rank matrix/tensor factorization and vector autoregressive (VAR) process into a single probabilistic graphical model, this framework can characterize both global and local consistencies in large-scale time series data. The graphical model allows us to effectively perform probabilistic predictions and produce uncertainty estimates without imputing those missing values. We develop efficient Gibbs sampling algorithms for model inference and model updating for real-time prediction and test the proposed BTF framework on several real-world spatiotemporal data sets for both missing data imputation and multi-step rolling prediction tasks. The numerical experiments demonstrate the superiority of the proposed BTF approaches over existing state-of-the-art methods.
引用
收藏
页码:4659 / 4673
页数:15
相关论文
共 50 条
  • [1] Temporal Regularized Matrix Factorization for High-dimensional Time Series Prediction
    Yu, Hsiang-Fu
    Rao, Nikhil
    Dhillon, Inderjit S.
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 29 (NIPS 2016), 2016, 29
  • [2] Temporal Autoregressive Matrix Factorization for High-Dimensional Time Series Prediction of OSS
    Chen, Liang
    Yang, Yun
    Wang, Wei
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 35 (10) : 1 - 12
  • [3] Back temporal autoregressive matrix factorization for high-dimensional time series prediction
    Chen, Liang
    Wang, Jing
    Wang, Wei
    Lou, ZeHua
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [4] Temporal Dynamic Matrix Factorization for Missing Data Prediction in Large Scale Coevolving Time Series
    Shi, Weiwei
    Zhu, Yongxin
    Yu, Philip S.
    Huang, Tian
    Wang, Chang
    Mao, Yishu
    Chen, Yufeng
    [J]. IEEE ACCESS, 2016, 4 : 6719 - 6732
  • [5] Factorization of a Spectral Density with Smooth Eigenvalues of a Multidimensional Stationary Time Series
    Szabados, Tamas
    [J]. ECONOMETRICS, 2023, 11 (02)
  • [6] A Low-Rank Bayesian Temporal Matrix Factorization for the Transfer Time Prediction Between Metro and Bus Systems
    Wu, Pan
    Pei, Mingyang
    Wang, Tao
    Liu, Yang
    Liu, Zhiyuan
    Zhong, Lingshu
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (07) : 7206 - 7222
  • [7] Bayesian MCMC nonlinear time series prediction
    Nakada, Y
    Kurihara, T
    Matsumoto, T
    [J]. 2001 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS I-VI, PROCEEDINGS: VOL I: SPEECH PROCESSING 1; VOL II: SPEECH PROCESSING 2 IND TECHNOL TRACK DESIGN & IMPLEMENTATION OF SIGNAL PROCESSING SYSTEMS NEURALNETWORKS FOR SIGNAL PROCESSING; VOL III: IMAGE & MULTIDIMENSIONAL SIGNAL PROCESSING MULTIMEDIA SIGNAL PROCESSING - VOL IV: SIGNAL PROCESSING FOR COMMUNICATIONS; VOL V: SIGNAL PROCESSING EDUCATION SENSOR ARRAY & MULTICHANNEL SIGNAL PROCESSING AUDIO & ELECTROACOUSTICS; VOL VI: SIGNAL PROCESSING THEORY & METHODS STUDENT FORUM, 2001, : 3509 - 3512
  • [8] Daily production prediction for coalbed methane based on Bayesian temporal matrix factorization
    Li, Yingjie
    Yang, Yongguo
    Kang, Junqiang
    Zhou, Dan
    [J]. JOURNAL OF NATURAL GAS SCIENCE AND ENGINEERING, 2022, 97
  • [9] Enhanced Bayesian Factorization With Variant Scale Partitioning for Multivariate Time Series
    Tang, Yunbo
    Chen, Dan
    Zuo, Yiping
    Lu, Xiaoqiang
    Ranjan, Rajiv
    Zomaya, Albert Y. Y.
    Yao, Quanming
    Li, Xiaoli
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (04) : 3832 - 3845
  • [10] Multidimensional Stationary Time Series Dimension Reduction and Prediction
    Sloboda, Brian W.
    [J]. INTERNATIONAL STATISTICAL REVIEW, 2024, 92 (01) : 130 - 132