Subgradient-based feedback neural networks for non-differentiable convex optimization problems

被引:7
|
作者
Li Guocheng [1 ]
Song Shiji [1 ]
Wu Cheng [1 ]
机构
[1] Tsinghua Univ, Ctr Intelligent & Networked Syst, Beijing 100084, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
projection subgradient; non-differentiable convex optimization; convergence; feedback neural network;
D O I
10.1007/s11432-006-2007-5
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper developed the dynamic feedback neural network model to solve the convex nonlinear programming problem proposed by Leung et aL and introduced subgradient-based dynamic feedback neural networks to solve non-differentiable convex optimization problems. For unconstrained non-differentiable convex optimization problem, on the assumption that the objective function is convex coercive, we proved that with arbitrarily given initial value, the trajectory of the feedback neural network constructed by a projection subgradient converges to an asymptotically stable equilibrium point which is also an optimal solution of the primal unconstrained problem. For constrained non-differentiable convex optimization problem, on the assumption that the objective function is convex coercive and the constraint functions are convex also, the energy functions sequence and corresponding dynamic feedback subneural network models based on a projection subgradient are successively constructed respectively, the convergence theorem is then obtained and the stopping condition is given. Furthermore, the effective algorithms are designed and some simulation experiments are illustrated.
引用
收藏
页码:421 / 435
页数:15
相关论文
共 50 条
  • [21] Discrete-time feedback control of highly nonlinear hybrid stochastic neural networks with non-differentiable delays
    Zhang, Bingrui
    Wu, Ailong
    Zhang, Jin-E
    [J]. INTERNATIONAL JOURNAL OF CONTROL, 2024,
  • [22] A SUBGRADIENT-BASED CONVEX APPROXIMATIONS METHOD FOR DC PROGRAMMING AND ITS APPLICATIONS
    Gu, Jian
    Xiao, Xiantao
    Zhang, Liwei
    [J]. JOURNAL OF INDUSTRIAL AND MANAGEMENT OPTIMIZATION, 2016, 12 (04) : 1349 - 1366
  • [23] Adversarial Variational Optimization of Non-Differentiable Simulators
    Louppe, Gilles
    Hermans, Joeri
    Cranmer, Kyle
    [J]. 22ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 89, 2019, 89
  • [24] On Non-differentiable Time-varying Optimization
    Simonetto, Andrea
    Leus, Geert
    [J]. 2015 IEEE 6TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING (CAMSAP), 2015, : 505 - 508
  • [25] An indefinite proximal subgradient-based algorithm for nonsmooth composite optimization
    Rui Liu
    Deren Han
    Yong Xia
    [J]. Journal of Global Optimization, 2023, 87 : 533 - 550
  • [26] An indefinite proximal subgradient-based algorithm for nonsmooth composite optimization
    Liu, Rui
    Han, Deren
    Xia, Yong
    [J]. JOURNAL OF GLOBAL OPTIMIZATION, 2023, 87 (2-4) : 533 - 550
  • [27] The Optimization of Nonlinear Programming Problem by Subgradient-Based Lagrangian Relaxation
    Lin, Wei-Cheng
    Lin, Yung-Chien
    Lo, Kie-Yang
    Chen, Po-Ying
    [J]. IEEE INTERNATIONAL SYMPOSIUM ON NEXT-GENERATION ELECTRONICS 2013 (ISNE 2013), 2013,
  • [28] A Subgradient-based Cutting Plane Method to Calculate Convex Hull Market Prices
    Wang, Congcong
    Luh, Peter B.
    Gribik, Paul
    Zhang, Li
    Peng, Tengshun
    [J]. 2009 IEEE POWER & ENERGY SOCIETY GENERAL MEETING, VOLS 1-8, 2009, : 360 - +
  • [29] CONVEX OPTIMIZATION PROBLEMS ON DIFFERENTIABLE SETS
    Zheng, Xi Yin
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2023, 33 (01) : 338 - 359
  • [30] Gradient-Based Adaptive Stochastic Search for Non-Differentiable Optimization
    Zhou, Enlu
    Hu, Jiaqiao
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2014, 59 (07) : 1818 - 1832