Fast Multiobjective Gradient Methods with Nesterov Acceleration via Inertial Gradient-Like Systems

被引:2
|
作者
Sonntag, Konstantin [1 ]
Peitz, Sebastian [2 ]
机构
[1] Paderborn Univ, Dept Math, D-33098 Paderborn, Germany
[2] Paderborn Univ, Dept Comp Sci, D-33098 Paderborn, Germany
关键词
Multiobjective optimization; Gradient methods; Nesterov acceleration; Inertial dynamics; Lyapunov analysis; DYNAMICAL-SYSTEM; PARETO-OPTIMIZATION; SLOW SOLUTIONS; EXISTENCE; CONVERGENCE;
D O I
10.1007/s10957-024-02389-3
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
We derive efficient algorithms to compute weakly Pareto optimal solutions for smooth, convex and unconstrained multiobjective optimization problems in general Hilbert spaces. To this end, we define a novel inertial gradient-like dynamical system in the multiobjective setting, which trajectories converge weakly to Pareto optimal solutions. Discretization of this system yields an inertial multiobjective algorithm which generates sequences that converge weakly to Pareto optimal solutions. We employ Nesterov acceleration to define an algorithm with an improved convergence rate compared to the plain multiobjective steepest descent method (Algorithm 1). A further improvement in terms of efficiency is achieved by avoiding the solution of a quadratic subproblem to compute a common step direction for all objective functions, which is usually required in first-order methods. Using a different discretization of our inertial gradient-like dynamical system, we obtain an accelerated multiobjective gradient method that does not require the solution of a subproblem in each step (Algorithm 2). While this algorithm does not converge in general, it yields good results on test problems while being faster than standard steepest descent.
引用
收藏
页码:539 / 582
页数:44
相关论文
共 50 条
  • [41] Gradient-like parabolic semiflows on BUC(RN)
    Daners, D
    Merino, S
    PROCEEDINGS OF THE ROYAL SOCIETY OF EDINBURGH SECTION A-MATHEMATICS, 1998, 128 : 1281 - 1291
  • [42] GRADIENT-LIKE DIFFEOMORPHISMS AND PERIODIC VECTOR FIELDS
    Grines, V. Z.
    Lerman, L. M.
    MOSCOW MATHEMATICAL JOURNAL, 2023, 23 (04) : 533 - 544
  • [43] GRADIENT-LIKE FLOWS ON 3-MANIFOLDS
    DEREZENDE, KA
    ERGODIC THEORY AND DYNAMICAL SYSTEMS, 1993, 13 : 557 - 580
  • [44] ON A GRADIENT-LIKE INTEGRO-DIFFERENTIAL EQUATION
    HALE, JK
    RYBAKOWSKI, KP
    PROCEEDINGS OF THE ROYAL SOCIETY OF EDINBURGH SECTION A-MATHEMATICS, 1982, 92 : 77 - 85
  • [45] Gradient-like algorithm for a class of nonsmooth equations
    Ling, Sheng-zhi
    2000, Changsha Univ Electric Power, Beijing, China (15):
  • [46] Robust Gradient-Like Property and Controller Design for Uncertain Pendulum-Like Systems
    Jin-Zhi Wang
    Zhi-Sheng Duan
    Lin Huang
    Journal of Dynamical and Control Systems, 2006, 12 : 229 - 246
  • [47] Robust analysis and synthesis for the gradient-like behaviour of uncertain pendulum-like systems
    Dun, Ao
    Geng, Zhiyong
    Huang, Lin
    INTERNATIONAL JOURNAL OF CONTROL, 2009, 82 (01) : 74 - 85
  • [48] The existence of attractors and strongly gradient-like flows
    Zheng, ZH
    Hu, FN
    CHAOS SOLITONS & FRACTALS, 2003, 18 (04) : 681 - 685
  • [49] Robust gradient-like property and controller design for uncertain pendulum-like systems
    Wang, JZ
    Duan, ZS
    Huang, L
    JOURNAL OF DYNAMICAL AND CONTROL SYSTEMS, 2006, 12 (02) : 229 - 246
  • [50] APPLICATIONS OF THE LOJASIEWICZ-SIMON GRADIENT INEQUALITY TO GRADIENT-LIKE EVOLUTION EQUATIONS
    Chill, Ralph
    Haraux, Alain
    Jendoubi, Mohamed Ali
    ANALYSIS AND APPLICATIONS, 2009, 7 (04) : 351 - 372