Non-asymptotic convergence bounds for Sinkhorn iterates and their gradients: a coupling approach.

被引:0
|
作者
Greco, Giacomo [1 ]
Noble, Maxence [2 ]
Conforti, Giovanni [2 ]
Oliviero-Durmus, Alain [2 ]
机构
[1] Eindhoven Univ Technol, Eindhoven, Netherlands
[2] Ecole Polytech, Palaiseau, France
基金
英国工程与自然科学研究理事会;
关键词
optimal transport; Sinkhorn algorithm; stochastic optimal control; Schrodinger bridge; OPTIMAL TRANSPORT; ENTROPY MINIMIZATION; MATRICES; TIME;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Computational optimal transport (OT) has recently emerged as a powerful framework with applications in various fields. In this paper we focus on a relaxation of the original OT problem, the entropic OT problem, which allows to implement efficient and practical algorithmic solutions, even in high dimensional settings. This formulation, also known as the Schrodinger Bridge problem, notably connects with Stochastic Optimal Control (SOC) and can be solved with the popular Sinkhorn algorithm. In the case of discrete-state spaces, this algorithm is known to have exponential convergence; however, achieving a similar rate of convergence in a more general setting is still an active area of research. In this work, we analyze the convergence of the Sinkhorn algorithm for probability measures defined on the d-dimensional torus T-L(d), that admit densities with respect to the Haar measure of T-L(d). In particular, we prove pointwise exponential convergence of Sinkhorn iterates and their gradient. Our proof relies on the connection between these iterates and the evolution along the Hamilton-Jacobi-Bellman equations of value functions obtained from SOC-problems. Our approach is novel in that it is purely probabilistic and relies on coupling by reflection techniques for controlled diffusions on the torus.
引用
收藏
页码:716 / 746
页数:31
相关论文
共 50 条
  • [1] Non-asymptotic convergence bounds for Wasserstein approximation using point clouds
    Merigot, Quentin
    Santambrogio, Filippo
    Sarrazin, Clement
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [2] THE PERTURBED PROX-PRECONDITIONED SPIDER ALGORITHM: NON-ASYMPTOTIC CONVERGENCE BOUNDS
    Fort, G.
    Moulines, E.
    2021 IEEE STATISTICAL SIGNAL PROCESSING WORKSHOP (SSP), 2021, : 96 - 100
  • [3] Non-asymptotic bounds for autoregressive approximation
    Goldenshluger, A
    Zeevi, A
    1998 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY - PROCEEDINGS, 1998, : 304 - 304
  • [4] CONVERGENCE OF THE EMPIRICAL MEASURE IN EXPECTED WASSERSTEIN DISTANCE: NON-ASYMPTOTIC EXPLICIT BOUNDS IN Rd
    Fournier, Nicolas
    ESAIM-PROBABILITY AND STATISTICS, 2023, 27 : 749 - 775
  • [5] Non-Asymptotic Error Bounds for Bidirectional GANs
    Liu, Shiao
    Yang, Yunfei
    Huang, Jian
    Jiao, Yuling
    Wang, Yang
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [6] Optimal Non-Asymptotic Bounds for the Sparse β Model
    Yang, Xiaowei
    Pan, Lu
    Cheng, Kun
    Liu, Chao
    MATHEMATICS, 2023, 11 (22)
  • [7] Almost Sure Convergence and Non-Asymptotic Concentration Bounds for Stochastic Mirror Descent Algorithm
    Paul, Anik Kumar
    Mahindrakar, Arun D.
    Kalaimani, Rachel K.
    IEEE Control Systems Letters, 2024, 8 : 2397 - 2402
  • [8] Distributed adaptive greedy quasi-Newton methods with explicit non-asymptotic convergence bounds
    Du, Yubo
    You, Keyou
    AUTOMATICA, 2024, 165
  • [9] Multiscale Dictionary Learning: Non-Asymptotic Bounds and Robustness
    Maggioni, Mauro
    Minsker, Stanislav
    Strawn, Nate
    JOURNAL OF MACHINE LEARNING RESEARCH, 2016, 17
  • [10] Non-Asymptotic Achievability Bounds in Multiuser Information Theory
    Verdue, Sergio
    2012 50TH ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2012, : 1 - 8