ANOVA-GP Modeling for High-Dimensional Bayesian Inverse Problems

被引:0
|
作者
Shi, Xiaoyu [1 ]
Zhang, Hanyu [1 ]
Wang, Guanjie [2 ]
机构
[1] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai 201210, Peoples R China
[2] Shanghai Lixin Univ Accounting & Finance, Sch Stat & Math, Shanghai 201209, Peoples R China
关键词
Bayesian inverse problem; uncertainty quantification; ANOVA decomposition; principle component analysis; Gaussian process regression; GAUSSIAN-PROCESSES; REDUCTION; PARAMETER;
D O I
10.3390/math12020301
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Markov chain Monte Carlo (MCMC) stands out as an effective method for tackling Bayesian inverse problems. However, when dealing with computationally expensive forward models and high-dimensional parameter spaces, the challenge of repeated sampling becomes pronounced. A common strategy to address this challenge is to construct an inexpensive surrogate of the forward model, which cuts the computational cost of individual samples. While the Gaussian process (GP) is widely used as a surrogate modeling strategy, its applicability can be limited when dealing with high-dimensional input or output spaces. This paper presents a novel approach that combines the analysis of variance (ANOVA) decomposition method with Gaussian process regression to handle high-dimensional Bayesian inverse problems. Initially, the ANOVA method is employed to reduce the dimension of the parameter space, which decomposes the original high-dimensional problem into several low-dimensional sub-problems. Subsequently, principal component analysis (PCA) is utilized to reduce the dimension of the output space on each sub-problem. Finally, a Gaussian process model with a low-dimensional input and output is constructed for each sub-problem. In addition to this methodology, an adaptive ANOVA-GP-MCMC algorithm is proposed, which further enhances the adaptability and efficiency of the method in the Bayesian inversion setting. The accuracy and computational efficiency of the proposed approach are validated through numerical experiments. This innovative integration of ANOVA and Gaussian processes provides a promising solution to address challenges associated with high-dimensional parameter spaces and computationally expensive forward models in Bayesian inference.
引用
收藏
页数:18
相关论文
共 50 条
  • [31] An Exploitation-Enhanced Bayesian Optimization Algorithm for High-Dimensional Expensive Problems
    Gui, Yuqian
    Zhan, Dawei
    Li, Tianrui
    [J]. ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT III, 2023, 14256 : 295 - 306
  • [32] Addressing the problems of Bayesian network classification of video using high-dimensional features
    Mittal, A
    Cheong, LF
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2004, 16 (02) : 230 - 244
  • [33] Objective-sensitive principal component analysis for high-dimensional inverse problems
    Elizarev, Maksim
    Mukhin, Andrei
    Khlyupin, Aleksey
    [J]. COMPUTATIONAL GEOSCIENCES, 2021, 25 (06) : 2019 - 2031
  • [34] Plug-in Estimation in High-Dimensional Linear Inverse Problems: A Rigorous Analysis
    Fletcher, Alyson K.
    Pandit, Parthe
    Rangan, Sundeep
    Sarkar, Subrata
    Schniter, Philip
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [35] Objective-sensitive principal component analysis for high-dimensional inverse problems
    Maksim Elizarev
    Andrei Mukhin
    Aleksey Khlyupin
    [J]. Computational Geosciences, 2021, 25 : 2019 - 2031
  • [36] Fundamental Performance Limits for Ideal Decoders in High-Dimensional Linear Inverse Problems
    Bourrier, Anthony
    Davies, Mike E.
    Peleg, Tomer
    Perez, Patrick
    Gribonval, Remi
    [J]. IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (12) : 7928 - 7946
  • [37] Modeling High-Dimensional Data
    Vempala, Santosh S.
    [J]. COMMUNICATIONS OF THE ACM, 2012, 55 (02) : 112 - 112
  • [38] HIGH-DIMENSIONAL ADDITIVE MODELING
    Meier, Lukas
    van de Geer, Sara
    Buehlmann, Peter
    [J]. ANNALS OF STATISTICS, 2009, 37 (6B): : 3779 - 3821
  • [39] Generalized functional ANOVA diagnostics for high-dimensional functions of dependent variables
    Hooker, Giles
    [J]. JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2007, 16 (03) : 709 - 732
  • [40] Comparative analyses of covariance matrix adaptation and iterative ensemble smoother on high-dimensional inverse problems in high-resolution groundwater modeling
    Yang, Shuo
    Tsai, Frank T. -C.
    Bacopoulos, Peter
    Kees, Christopher E.
    [J]. JOURNAL OF HYDROLOGY, 2023, 625