ANOVA-GP Modeling for High-Dimensional Bayesian Inverse Problems

被引:0
|
作者
Shi, Xiaoyu [1 ]
Zhang, Hanyu [1 ]
Wang, Guanjie [2 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai 201210, Peoples R China
[2] Shanghai Lixin Univ Accounting & Finance, Sch Stat & Math, Shanghai 201209, Peoples R China
关键词
Bayesian inverse problem; uncertainty quantification; ANOVA decomposition; principle component analysis; Gaussian process regression; GAUSSIAN-PROCESSES; REDUCTION; PARAMETER;
D O I
10.3390/math12020301
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Markov chain Monte Carlo (MCMC) stands out as an effective method for tackling Bayesian inverse problems. However, when dealing with computationally expensive forward models and high-dimensional parameter spaces, the challenge of repeated sampling becomes pronounced. A common strategy to address this challenge is to construct an inexpensive surrogate of the forward model, which cuts the computational cost of individual samples. While the Gaussian process (GP) is widely used as a surrogate modeling strategy, its applicability can be limited when dealing with high-dimensional input or output spaces. This paper presents a novel approach that combines the analysis of variance (ANOVA) decomposition method with Gaussian process regression to handle high-dimensional Bayesian inverse problems. Initially, the ANOVA method is employed to reduce the dimension of the parameter space, which decomposes the original high-dimensional problem into several low-dimensional sub-problems. Subsequently, principal component analysis (PCA) is utilized to reduce the dimension of the output space on each sub-problem. Finally, a Gaussian process model with a low-dimensional input and output is constructed for each sub-problem. In addition to this methodology, an adaptive ANOVA-GP-MCMC algorithm is proposed, which further enhances the adaptability and efficiency of the method in the Bayesian inversion setting. The accuracy and computational efficiency of the proposed approach are validated through numerical experiments. This innovative integration of ANOVA and Gaussian processes provides a promising solution to address challenges associated with high-dimensional parameter spaces and computationally expensive forward models in Bayesian inference.
引用
收藏
页数:18
相关论文
共 50 条
  • [21] An enhanced Kriging surrogate modeling technique for high-dimensional problems
    Zhou, Yicheng
    Lu, Zhenzhou
    [J]. MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2020, 140
  • [22] Bayesian and High-Dimensional Global Optimization
    Sergeyev, Yaroslav D.
    [J]. OPTIMIZATION LETTERS, 2021, 15 (08) : 2897 - 2899
  • [23] GROUPED TRANSFORMATIONS AND REGULARIZATION IN HIGH-DIMENSIONAL EXPLAINABLE ANOVA APPROXIMATION
    Bartel, Felix
    Potts, Daniel
    Schmischke, Michael
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2022, 44 (03): : A1606 - A1631
  • [24] Bayesian Optimization with High-Dimensional Outputs
    Maddox, Wesley J.
    Balandat, Maximilian
    Wilson, Andrew Gordon
    Bakshy, Eytan
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [25] Generic framework for high-dimensional fixed-effects ANOVA
    Smilde, Age K.
    Timmerman, Marieke E.
    Hendriks, Margriet M. W. B.
    Jansen, Jeroen J.
    Hoefsloot, Huub C. J.
    [J]. BRIEFINGS IN BIOINFORMATICS, 2012, 13 (05) : 524 - 535
  • [26] Variable transformations in combination with wavelets and ANOVA for high-dimensional approximation
    Potts, Daniel
    Weidensager, Laura
    [J]. ADVANCES IN COMPUTATIONAL MATHEMATICS, 2024, 50 (03)
  • [27] Inference for mixed models of ANOVA type with high-dimensional data
    Chen, Fei
    Li, Zaixing
    Shi, Lei
    Zhu, Lixing
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2015, 133 : 382 - 401
  • [28] Maximum Likelihood Estimation of Regularization Parameters in High-Dimensional Inverse Problems: An Empirical Bayesian Approach Part I: Methodology and Experiments
    Vidal, Ana Fernandez
    De Bortoli, Valentin
    Pereyra, Marcelo
    Durmus, Alain
    [J]. SIAM JOURNAL ON IMAGING SCIENCES, 2020, 13 (04): : 1945 - 1989
  • [29] Bayesian optimization techniques for high-dimensional simulation-based transportation problems
    Tay, Timothy
    Osorio, Carolina
    [J]. TRANSPORTATION RESEARCH PART B-METHODOLOGICAL, 2022, 164 : 210 - 243
  • [30] Bayesian optimization techniques for high-dimensional simulation-based transportation problems
    Tay, Timothy
    Osorio, Carolina
    [J]. Transportation Research Part B: Methodological, 2022, 164 : 210 - 243