Accelerating Proximal Markov Chain Monte Carlo by Using an Explicit Stabilized Method

被引:23
|
作者
Pereyra, Marcelo [1 ,2 ]
Mieles, Luis Vargas [1 ,2 ,3 ]
Zygalakis, Konstantinos C. [2 ,3 ]
机构
[1] Heriot Watt Univ, Sch Math & Comp Sci, Edinburgh EH14 4AS, Midlothian, Scotland
[2] Bayes Ctr, Maxwell Inst Math Sci, Edinburgh EH8 9BT, Midlothian, Scotland
[3] Univ Edinburgh, Sch Math, Edinburgh EH9 3FD, Midlothian, Scotland
来源
SIAM JOURNAL ON IMAGING SCIENCES | 2020年 / 13卷 / 02期
关键词
mathematical imaging; inverse problems; Bayesian inference; Markov chain Monte Carlo methods; proximal algorithms; MEAN-SQUARE; LANGEVIN; REGULARIZATION; OPTIMIZATION; ALGORITHM; NOISE; STIFF;
D O I
10.1137/19M1283719
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a highly efficient proximal Markov chain Monte Carlo methodology to perform Bayesian computation in imaging problems. Similarly to previous proximal Monte Carlo approaches, the proposed method is derived from an approximation of the Langevin diffusion. However, instead of the conventional Euler-Maruyama approximation that underpins existing proximal Monte Carlo methods, here we use a state-of-the-art orthogonal Runge-Kutta-Chebyshev stochastic approximation [A. Abdulle, I. Aimuslimani, and G. Vilmart, SIAM/ASA J. Uncertain. Quantif., 6 (2018), pp. 937-964] that combines several gradient evaluations to significantly accelerate its convergence speed, similarly to accelerated gradient optimization methods. The proposed methodology is demonstrated via a range of numerical experiments, including non-blind image deconvolution, hyperspectral unmixing, and tomographic reconstruction, with total-variation and l(1)-type priors. Comparisons with Euler-type proximal Monte Carlo methods confirm that the Markov chains generated with our method exhibit significantly faster convergence speeds, achieve larger effective sample sizes, and produce lower mean-square estimation errors at equal computational budget.
引用
收藏
页码:905 / 935
页数:31
相关论文
共 50 条
  • [41] LDPC Decoder Based on Markov Chain Monte Carlo Method
    Jin, Jiejun
    Liang, Xiao
    Xu, Yunhao
    Zhang, Zaichen
    You, Xiaohu
    Zhang, Chuan
    2018 IEEE ASIA PACIFIC CONFERENCE ON CIRCUITS AND SYSTEMS (APCCAS 2018), 2018, : 219 - 222
  • [42] Application of Markov chain Monte carlo method in Bayesian statistics
    Zhao, Qi
    2016 INTERNATIONAL CONFERENCE ON ELECTRONIC, INFORMATION AND COMPUTER ENGINEERING, 2016, 44
  • [43] A Markov chain Monte Carlo method for estimation and assimilation into models
    Harmon, R
    Challenor, P
    ECOLOGICAL MODELLING, 1997, 101 (01) : 41 - 59
  • [44] Population Markov Chain Monte Carlo
    Laskey, KB
    Myers, JW
    MACHINE LEARNING, 2003, 50 (1-2) : 175 - 196
  • [45] Monte Carlo integration with Markov chain
    Tan, Zhiqiang
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2008, 138 (07) : 1967 - 1980
  • [46] Population Markov Chain Monte Carlo
    Kathryn Blackmond Laskey
    James W. Myers
    Machine Learning, 2003, 50 : 175 - 196
  • [47] Simulating skylight polarization patterns using the backward Markov Chain Monte Carlo method
    Li, Shuai
    Wang, Rui
    Cheng, Jiuming
    Dai, Congming
    Xu, Wenqing
    Wei, Heli
    Zhan, Jie
    ASTRONOMY AND COMPUTING, 2024, 46
  • [48] Decision making of HVAC system using Bayesian Markov chain Monte Carlo method
    Kim, Young-Jin
    Ahn, Ki-Uhn
    Park, Cheol-Soo
    ENERGY AND BUILDINGS, 2014, 72 : 112 - 121
  • [49] Human tracking using floor sensors based on the Markov chain Monte Carlo method
    Murakita, T
    Ikeda, T
    Ishiguro, H
    PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 4, 2004, : 917 - 920
  • [50] On nonlinear Markov chain Monte Carlo
    Andrieu, Christophe
    Jasra, Ajay
    Doucet, Arnaud
    Del Moral, Pierre
    BERNOULLI, 2011, 17 (03) : 987 - 1014