Distributed Smoothing Projection Neurodynamic Approaches for Constrained Nonsmooth Optimization

被引:5
|
作者
Zhao, You [1 ]
Liao, Xiaofeng [1 ]
He, Xing [2 ]
机构
[1] Chongqing Univ, Coll Comp Sci, Key Lab Dependable Serv Comp Cyber Phys Soc, Minist Educ, Chongqing 400044, Peoples R China
[2] Southwest Univ, Sch Elect & Informat Engn, Chongqing Key Lab Nonlinear Circuits & Intelligen, Chongqing 400715, Peoples R China
基金
中国国家自然科学基金;
关键词
Arithmetic and exponential convergence; distributed smoothing projection neurodynamic approach (DSPNA); nonsmooth; CONVEX-OPTIMIZATION; NEURAL-NETWORK; ALGORITHM; COORDINATION;
D O I
10.1109/TSMC.2022.3186019
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This article considers constrained nonsmooth generalized convex and strongly convex optimization problems. For such problems, two novel distributed smoothing projection neurodynamic approaches (DSPNAs) are proposed to seek their optimal solutions with faster convergence rates in a distributed manner. First, we equivalently transform the original constrained optimal problem into a standard smoothing distributed problem with only local set constraints based on an exact penalty and smoothing approximation methods. Then, to deal with nonsmooth generally convex optimization, we propose a novel DSPNA based on continuous variant of Nesterov's acceleration (called DSPNA-N), which has a faster convergence rate O(1/t(2)), and we design a novel DSPNA inspired by the continuous variant of Polyak's heavy ball method (called DSPNA-P) to address the nonsmooth strongly convex optimal problem with an explicit exponential convergent rate. In addition, the existence, uniqueness, and feasibility of the solution of our proposed DSPNAs are also provided. Finally, numerical results demonstrate the effectiveness of DSPNAs.
引用
收藏
页码:675 / 688
页数:14
相关论文
共 50 条
  • [41] A Stochastic Nesterov's Smoothing Accelerated Method for General Nonsmooth Constrained Stochastic Composite Convex Optimization
    Wang, Ruyu
    Zhang, Chao
    Wang, Lichun
    Shao, Yuanhai
    [J]. JOURNAL OF SCIENTIFIC COMPUTING, 2022, 93 (02)
  • [42] A Stochastic Gradient-Based Projection Algorithm for Distributed Constrained Optimization
    Zhang, Keke
    Gao, Shanfu
    Chen, Yingjue
    Zheng, Zuqing
    Lu, Qingguo
    [J]. NEURAL INFORMATION PROCESSING, ICONIP 2023, PT I, 2024, 14447 : 356 - 367
  • [43] A SMOOTHING DIRECT SEARCH METHOD FOR MONTE CARLO-BASED BOUND CONSTRAINED COMPOSITE NONSMOOTH OPTIMIZATION
    Chen, Xiaojun
    Kelley, C. T.
    Xu, Fengmin
    Zhang, Zaikun
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2018, 40 (04): : A2174 - A2199
  • [44] A Stochastic Nesterov’s Smoothing Accelerated Method for General Nonsmooth Constrained Stochastic Composite Convex Optimization
    Ruyu Wang
    Chao Zhang
    Lichun Wang
    Yuanhai Shao
    [J]. Journal of Scientific Computing, 2022, 93
  • [45] Distributed Neurodynamic Optimization for Coordination of Redundant Robots
    Fang, Xiaomeng
    Le, Xinyi
    Li, Fei
    [J]. 2019 9TH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND TECHNOLOGY (ICIST2019), 2019, : 78 - 84
  • [46] Distributed Neurodynamic Optimization for Energy Internet Management
    Le, Xinyi
    Chen, Sijie
    Li, Fei
    Yan, Zheng
    Xi, Juntong
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2019, 49 (08): : 1624 - 1633
  • [47] Adaptive Neurodynamic Approach to Multiple Constrained Distributed Resource Allocation
    Luan, Linhua
    Qin, Sitian
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, : 1 - 11
  • [48] A Neurodynamic Approach to L0-Constrained Optimization
    Wang, Yadi
    Li, Xiaoping
    Wang, Jun
    [J]. 2020 12TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), 2020, : 44 - 50
  • [49] A collective neurodynamic optimization approach to bound-constrained nonconvex optimization
    Yan, Zheng
    Wang, Jun
    Li, Guocheng
    [J]. NEURAL NETWORKS, 2014, 55 : 20 - 29
  • [50] Accelerated Primal-Dual Projection Neurodynamic Approach With Time Scaling for Linear and Set Constrained Convex Optimization Problems
    Zhao, You
    He, Xing
    Zhou, Mingliang
    Huang, Tingwen
    [J]. IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2024, 11 (06) : 1485 - 1498