Bayesian hierarchical spatio-temporal smoothing for very large datasets

被引:74
|
作者
Katzfuss, Matthias [1 ]
Cressie, Noel [2 ]
机构
[1] Heidelberg Univ, Inst Angew Math, D-69120 Heidelberg, Germany
[2] Ohio State Univ, Dept Stat, Columbus, OH 43210 USA
关键词
Bayesian hierarchical modelling; massive datasets; dimension reduction; varying model dimension; global CO2; remote sensing; MODELS; TEMPERATURES; VARIABILITY;
D O I
10.1002/env.1147
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Spatio-temporal statistics is prone to the curse of dimensionality: one manifestation of this is inversion of the datacovariance matrix, which is not in general feasible for very-large-to-massive datasets, such as those observed by satellite instruments. This becomes even more of a problem in fully Bayesian statistical models, where the inversion typically has to be carried out many times in Markov chain Monte Carlo samplers. Here, we propose a Bayesian hierarchical spatio-temporal random effects (STRE) model that offers fast computation: Dimension reduction is achieved by projecting the process onto a basis-function space of low, fixed dimension, and the temporal evolution is modeled using a dynamical autoregressive model in time. We develop a multiresolutional prior for the propagator matrix that allows for unknown (random) sparsity and shrinkage, and we describe how sampling from the posterior distribution can be achieved in a feasible way, even if this matrix is very large. Finally, we compare inference based on our fully Bayesian STRE model with that based on an empirical-Bayesian STRE-model approach, where parameters are estimated via an expectation-maximization algorithm. The comparison is carried out in a simulation study and on a real-world dataset of global satellite CO2 measurements. Copyright (C) 2011 John Wiley & Sons, Ltd.
引用
收藏
页码:94 / 107
页数:14
相关论文
共 50 条
  • [1] Data Reduction in Very Large Spatio-Temporal Datasets
    Whelan, Michael
    Nhien An Le Khac
    Kechadi, M-Tahar
    [J]. 19TH IEEE INTERNATIONAL WORKSHOPS ON ENABLING TECHNOLOGIES: INFRASTRUCTURE FOR COLLABORATIVE ENTERPRISES (WETICE 2010), 2010, : 104 - 109
  • [2] A BAYESIAN SPATIO-TEMPORAL GEOSTATISTICAL MODEL WITH AN AUXILIARY LATTICE FOR LARGE DATASETS
    Xu, Ganggang
    Liang, Faming
    Genton, Marc G.
    [J]. STATISTICA SINICA, 2015, 25 (01) : 61 - 79
  • [3] Spatio-Temporal Data Fusion for Very Large Remote Sensing Datasets
    Hai Nguyen
    Katzfuss, Matthias
    Cressie, Noel
    Braverman, Amy
    [J]. TECHNOMETRICS, 2014, 56 (02) : 174 - 185
  • [4] Studying the Impact of Partition on Data Reduction for Very Large Spatio-temporal Datasets
    Nhien An Le Khac
    Bue, Martin
    Kechadi, M-Tahar
    [J]. DBKDA 2011: THE THIRD INTERNATIONAL CONFERENCE ON ADVANCES IN DATABASES, KNOWLEDGE, AND DATA APPLICATIONS, 2011, : 41 - 46
  • [5] A Clustering-Based Data Reduction for Very Large Spatio-Temporal Datasets
    Le-Khac, Nhien-An
    Bue, Martin
    Whelan, Michael
    Kechadi, M-Tahar
    [J]. ADVANCED DATA MINING AND APPLICATIONS (ADMA 2010), PT II, 2010, 6441 : 43 - 54
  • [6] A Bayesian hierarchical spatio-temporal rainfall model
    Mashford, John
    Song, Yong
    Wang, Q. J.
    Robertson, David
    [J]. JOURNAL OF APPLIED STATISTICS, 2019, 46 (02) : 217 - 229
  • [7] Adaptive kernel smoothing regression for spatio-temporal environmental datasets
    Pouzols, Federico Montesino
    Lendasse, Amaury
    [J]. NEUROCOMPUTING, 2012, 90 : 59 - 65
  • [8] Scalable spatio-temporal smoothing via hierarchical sparse Cholesky decomposition
    Jurek, Marcin
    Katzfuss, Matthias
    [J]. ENVIRONMETRICS, 2023, 34 (01)
  • [9] A hierarchical Bayesian spatio-temporal model for extreme precipitation events
    Ghosh, Souparno
    Mallick, Bani K.
    [J]. ENVIRONMETRICS, 2011, 22 (02) : 192 - 204
  • [10] Bayesian Spatio-temporal Hierarchical Modeling in Wind Speed Data
    Lee, Chee Nian
    Ong, Hong Choon
    [J]. PROCEEDINGS OF THE 24TH NATIONAL SYMPOSIUM ON MATHEMATICAL SCIENCES (SKSM24): MATHEMATICAL SCIENCES EXPLORATION FOR THE UNIVERSAL PRESERVATION, 2017, 1870