Swarm gradient dynamics for global optimization: the mean-field limit case

被引:0
|
作者
Jérôme Bolte
Laurent Miclo
Stéphane Villeneuve
机构
[1] University of Toulouse Capitole,Toulouse School of Economics
[2] CNRS-IMT-TSE-R,undefined
[3] TSE-TSM-R,undefined
来源
Mathematical Programming | 2024年 / 205卷
关键词
60F05; 58J65; 35K55; 49Q22;
D O I
暂无
中图分类号
学科分类号
摘要
Using jointly geometric and stochastic reformulations of nonconvex problems and exploiting a Monge–Kantorovich (or Wasserstein) gradient system formulation with vanishing forces, we formally extend the simulated annealing method to a wide range of global optimization methods. Due to the built-in combination of a gradient-like strategy and particle interactions, we call them swarm gradient dynamics. As in the original paper by Holley–Kusuoka–Stroock, a functional inequality is the key to the existence of a schedule that ensures convergence to a global minimizer. One of our central theoretical contributions is proving such an inequality for one-dimensional compact manifolds. We conjecture that the inequality holds true in a much broader setting. Additionally, we describe a general method for global optimization that highlights the essential role of functional inequalities la Łojasiewicz.
引用
收藏
页码:661 / 701
页数:40
相关论文
共 50 条
  • [1] Swarm gradient dynamics for global optimization: the mean-field limit case
    Bolte, Jerome
    Miclo, Laurent
    Villeneuve, Stephane
    [J]. MATHEMATICAL PROGRAMMING, 2024, 205 (1-2) : 661 - 701
  • [2] A note on the mean-field limit for the particle swarm optimization
    Huang, Hui
    [J]. APPLIED MATHEMATICS LETTERS, 2021, 117
  • [3] From particle swarm optimization to consensus based optimization: Stochastic modeling and mean-field limit
    Grassi, Sara
    Pareschi, Lorenzo
    [J]. MATHEMATICAL MODELS & METHODS IN APPLIED SCIENCES, 2021, 31 (08): : 1625 - 1657
  • [4] A consensus-based model for global optimization and its mean-field limit
    Pinnau, Rene
    Totzeck, Claudia
    Tse, Oliver
    Martin, Stephan
    [J]. MATHEMATICAL MODELS & METHODS IN APPLIED SCIENCES, 2017, 27 (01): : 183 - 204
  • [5] On the mean-field limit for the consensus-based optimization
    Huang, Hui
    Qiu, Jinniao
    [J]. MATHEMATICAL METHODS IN THE APPLIED SCIENCES, 2022, 45 (12) : 7814 - 7831
  • [6] PERFORMANCE BOUNDS FOR THE MEAN-FIELD LIMIT OF CONSTRAINED DYNAMICS
    Herty, Michael
    Zanella, Mattia
    [J]. DISCRETE AND CONTINUOUS DYNAMICAL SYSTEMS, 2017, 37 (04) : 2023 - 2043
  • [7] Modeling crowd dynamics by the mean-field limit approach
    Dogbe, Christian
    [J]. MATHEMATICAL AND COMPUTER MODELLING, 2010, 52 (9-10) : 1506 - 1520
  • [8] Stochastic consensus dynamics for nonconvex optimization on the Stiefel manifold: Mean-field limit and convergence
    Ha, Seung-Yeal
    Kang, Myeongju
    Kim, Dohyun
    Kim, Jeongho
    Yang, Insoon
    [J]. MATHEMATICAL MODELS & METHODS IN APPLIED SCIENCES, 2022, 32 (03): : 533 - 617
  • [9] The Hydrodynamic Limit for Local Mean-Field Dynamics with Unbounded Spins
    Bovier, Anton
    Ioffe, Dmitry
    Mueller, Patrick
    [J]. JOURNAL OF STATISTICAL PHYSICS, 2018, 172 (02) : 434 - 457
  • [10] On the dynamics of the mean-field polaron in the high-frequency limit
    Griesemer, Marcel
    Schmid, Jochen
    Schneider, Guido
    [J]. LETTERS IN MATHEMATICAL PHYSICS, 2017, 107 (10) : 1809 - 1821