Truncated Log-concave Sampling for Convex Bodies with Reflective Hamiltonian Monte Carlo

被引:6
|
作者
Chalkis, Apostolos [1 ]
Fisikopoulos, Vissarion [1 ]
Papachristou, Marios [2 ]
Tsigaridas, Elias [3 ]
机构
[1] Natl Kapodistrian Univ Athens, Dept Telemat & Telecommun, Panepistimiopolis, Athens 15784, Greece
[2] 302 Gates Hall,107 Hoy Rd, Ithaca, NY USA
[3] Case courrier 247, Pl Jussieu, F-75252 Paris 05, France
来源
关键词
Statistical software; truncated sampling; geometric random walks; experiments; mixing time; HIT-AND-RUN; LANGEVIN; MODELS; VOLUME; MCMC;
D O I
10.1145/3589505
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We introduce Reflective Hamiltonian Monte Carlo (ReHMC), an HMC-based algorithm to sample from a log-concave distribution restricted to a convex body. The random walk is based on incorporating reflections to the Hamiltonian dynamics such that the support of the target density is the convex body. We develop an efficient open source implementation of ReHMC and perform an experimental study on various high-dimensional datasets. The experiments suggest that ReHMC outperforms Hit-and-Run and Coordinate-Hit-and-Run regarding the time it needs to produce an independent sample, introducing practical truncated sampling in thousands of dimensions.
引用
收藏
页数:25
相关论文
共 50 条
  • [1] Sampling from a Log-Concave Distribution with Projected Langevin Monte Carlo
    Sébastien Bubeck
    Ronen Eldan
    Joseph Lehec
    Discrete & Computational Geometry, 2018, 59 : 757 - 783
  • [2] Sampling from a Log-Concave Distribution with Projected Langevin Monte Carlo
    Bubeck, Sebastien
    Eldan, Ronen
    Lehec, Joseph
    DISCRETE & COMPUTATIONAL GEOMETRY, 2018, 59 (04) : 757 - 783
  • [3] MIXING OF HAMILTONIAN MONTE CARLO ON STRONGLY LOG-CONCAVE DISTRIBUTIONS: CONTINUOUS DYNAMICS
    Mangoubi, Oren
    Smith, Aaron
    ANNALS OF APPLIED PROBABILITY, 2021, 31 (05): : 2019 - 2045
  • [4] Mixing of Hamiltonian Monte Carlo on strongly log-concave distributions 2: Numerical integrators
    Mangoubi, Oren
    Smith, Aaron
    22ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 89, 2019, 89 : 586 - 595
  • [5] On convex bodies and log-concave probability measures with unconditional basis
    Bobkov, SG
    Nazarov, FL
    GEOMETRIC ASPECTS OF FUNCTIONAL ANALYSIS, 2003, 1807 : 53 - 69
  • [6] A Note on the Spectral Gap for Log-Concave Probability Measures on Convex Bodies
    Bonnefont, Michel
    Joulin, Alderic
    INTERNATIONAL MATHEMATICS RESEARCH NOTICES, 2024,
  • [7] An isoperimetric inequality for uniformly log-concave measures and uniformly convex bodies
    Milman, Emanuel
    Sodin, Sasha
    JOURNAL OF FUNCTIONAL ANALYSIS, 2008, 254 (05) : 1235 - 1268
  • [8] SAMPLING FROM LOG-CONCAVE DISTRIBUTIONS
    Frieze, Alan
    Kannan, Ravi
    Polson, Nick
    ANNALS OF APPLIED PROBABILITY, 1994, 4 (03): : 812 - 837
  • [9] THE LANGEVIN MONTE CARLO ALGORITHM IN THE NON-SMOOTH LOG-CONCAVE CASE
    Lehec, Joseph
    ANNALS OF APPLIED PROBABILITY, 2023, 33 (6A): : 4858 - 4874
  • [10] Covariance inequalities for convex and log-concave functions
    Bonnefont, Michel
    Hillion, Erwan
    Saumard, Adrien
    ALEA-LATIN AMERICAN JOURNAL OF PROBABILITY AND MATHEMATICAL STATISTICS, 2024, 21 : 627 - 660