A second-order gradient method for convex minimization

被引:0
|
作者
Oviedo, Harry [1 ]
机构
[1] Fdn Getulio Vargas FGV EMAp, Escola Matemat Aplicada, Rio De Janeiro, RJ, Brazil
来源
关键词
Gradient methods; Convex quadratic optimization; Hessian spectral properties; Steplength selection; BARZILAI; DESCENT;
D O I
10.1007/s40590-021-00375-7
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
This work addresses the strictly convex unconstrained minimization problem via a modified version of the gradient method. The proposal is a line search method that uses a search direction based on the gradient method. This new direction is constructed by a mixture of the negative direction of the gradient with another particular direction that uses second-order information. Unlike Newton-type methods, our algorithm does not need to compute the inverse of the Hessian of the objective function. We analyze the global convergence under an exact line search. A numerical study is carried out, to illustrate the numerical effectiveness of the method by comparing it with some conjugate gradient methods and also with the Barzilai-Borwein gradient method both in quadratic and non-linear problems.
引用
收藏
页数:15
相关论文
共 50 条
  • [11] Alternating Proximal Gradient Method for Convex Minimization
    Shiqian Ma
    Journal of Scientific Computing, 2016, 68 : 546 - 572
  • [12] Alternating Proximal Gradient Method for Convex Minimization
    Ma, Shiqian
    JOURNAL OF SCIENTIFIC COMPUTING, 2016, 68 (02) : 546 - 572
  • [13] On damped second-order gradient systems
    Begout, Pascal
    Bolte, Jerome
    Jendoubi, Mohamed Ali
    JOURNAL OF DIFFERENTIAL EQUATIONS, 2015, 259 (07) : 3115 - 3143
  • [14] GRADIENT FLOWS, SECOND-ORDER GRADIENT SYSTEMS AND CONVEXITY
    Boulmezaoud, Tahar Z.
    Cieutat, Philippe
    Daniilidis, Aris
    SIAM JOURNAL ON OPTIMIZATION, 2018, 28 (03) : 2049 - 2066
  • [15] Second-order subgradients of convex integral functionals
    Moussaoui, M
    Seeger, A
    TRANSACTIONS OF THE AMERICAN MATHEMATICAL SOCIETY, 1999, 351 (09) : 3687 - 3711
  • [16] Motion blur target tracking method based on efficient second-order minimization
    Zhao, Y. (zy_ky7777@126.com), 1678, Northeast University (34):
  • [17] Approaching nonsmooth nonconvex minimization through second-order proximal-gradient dynamical systems
    Radu Ioan Boţ
    Ernö Robert Csetnek
    Szilárd Csaba László
    Journal of Evolution Equations, 2018, 18 : 1291 - 1318
  • [18] Approaching nonsmooth nonconvex minimization through second-order proximal-gradient dynamical systems
    Bot, Radu Ioan
    Csetnek, Ernoe Robert
    Laszlo, Szilard Csaba
    JOURNAL OF EVOLUTION EQUATIONS, 2018, 18 (03) : 1291 - 1318
  • [19] AN ALTERNATING DIRECTIONS METHOD OF MULTIPLIERS FOR CONVEX QUADRATIC SECOND-ORDER CONE PROGRAMMING
    Mu, Xuewen
    Zhang, Yaling
    PACIFIC JOURNAL OF OPTIMIZATION, 2018, 14 (02): : 369 - 380
  • [20] Second-Order Optimality in Non-Convex Decentralized Optimization via Perturbed Gradient Tracking
    Tziotis, Isidoros
    Caramanis, Constantine
    Mokhtari, Aryan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33