Stochastic saddle-point optimization for the Wasserstein barycenter problem

被引:3
|
作者
Tiapkin, Daniil [1 ]
Gasnikov, Alexander [1 ,2 ,3 ]
Dvurechensky, Pavel [3 ,4 ]
机构
[1] HSE Univ, Moscow, Russia
[2] Moscow Inst Phys & Technol, Moscow, Russia
[3] Inst Informat Transmiss Problems, Moscow, Russia
[4] Weierstrass Inst Appl Anal & Stochast, Berlin, Germany
基金
俄罗斯科学基金会;
关键词
Stochastic optimization; Saddle-point optimization; Computational optimal transport; Wasserstein barycenter problem; CONVEX; APPROXIMATION; ALGORITHMS;
D O I
10.1007/s11590-021-01834-w
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We consider the population Wasserstein barycenter problem for random probability measures supported on a finite set of points and generated by an online stream of data. This leads to a complicated stochastic optimization problem where the objective is given as an expectation of a function given as a solution to a random optimization problem. We employ the structure of the problem and obtain a convex-concave stochastic saddle-point reformulation of this problem. In the setting when the distribution of random probability measures is discrete, we propose a stochastic optimization algorithm and estimate its complexity. The second result, based on kernel methods, extends the previous one to the arbitrary distribution of random probability measures. Moreover, this new algorithm has a total complexity better than the Stochastic Approximation approach combined with the Sinkhorn algorithm in many cases. We also illustrate our developments by a series of numerical experiments.
引用
收藏
页码:2145 / 2175
页数:31
相关论文
共 50 条
  • [1] Stochastic saddle-point optimization for the Wasserstein barycenter problem
    Daniil Tiapkin
    Alexander Gasnikov
    Pavel Dvurechensky
    Optimization Letters, 2022, 16 : 2145 - 2175
  • [2] Distributed Stochastic Optimization of Regularized Risk via Saddle-Point Problem
    Matsushima, Shin
    Yun, Hyokun
    Zhang, Xinhua
    Vishwanathan, S. V. N.
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2017, PT I, 2017, 10534 : 460 - 476
  • [3] A METHOD OF FINDING A STOCHASTIC SADDLE-POINT
    NOVIKOVA, NM
    USSR COMPUTATIONAL MATHEMATICS AND MATHEMATICAL PHYSICS, 1989, 29 (01): : 27 - 34
  • [4] BARRIER FUNCTION METHOD AND SADDLE-POINT FOR FRACTIONAL OPTIMIZATION PROBLEM
    Preeti, Ioan
    Stancu-Minasian, Ioan
    Jayswal, Anurag
    Rusu-Stancu, Andreea Madalina
    UNIVERSITY POLITEHNICA OF BUCHAREST SCIENTIFIC BULLETIN-SERIES A-APPLIED MATHEMATICS AND PHYSICS, 2023, 85 (01): : 65 - 76
  • [5] Accelerated Methods for Saddle-Point Problem
    M. S. Alkousa
    A. V. Gasnikov
    D. M. Dvinskikh
    D. A. Kovalev
    F. S. Stonyakin
    Computational Mathematics and Mathematical Physics, 2020, 60 : 1787 - 1809
  • [6] Accelerated Methods for Saddle-Point Problem
    Alkousa, M. S.
    Gasnikov, A., V
    Dvinskikh, D. M.
    Kovalev, D. A.
    Stonyakin, F. S.
    COMPUTATIONAL MATHEMATICS AND MATHEMATICAL PHYSICS, 2020, 60 (11) : 1787 - 1809
  • [7] Nested BDDC for a saddle-point problem
    Bedřich Sousedík
    Numerische Mathematik, 2013, 125 : 761 - 783
  • [8] Saddle-point method in the radiation problem
    Khokonov, MK
    PHYSICA SCRIPTA, 1997, 55 (05): : 513 - 519
  • [9] Phase retrieval and saddle-point optimization
    Marchesini, Stefano
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2007, 24 (10) : 3289 - 3296
  • [10] Nested BDDC for a saddle-point problem
    Sousedik, Bedrich
    NUMERISCHE MATHEMATIK, 2013, 125 (04) : 761 - 783