Neurodynamic Algorithms With Finite/Fixed-Time Convergence for Sparse Optimization via l1 Regularization

被引:5
|
作者
Wen, Hongsong [1 ]
He, Xing [1 ]
Huang, Tingwen [2 ]
Yu, Junzhi [3 ,4 ]
机构
[1] Southwest Univ, Coll Elect & Informat Engn, Chongqing Key Lab Nonlinear Circuits & Intelligent, Chongqing 400715, Peoples R China
[2] Texas A&M Univ Qatar, Dept Math, Doha, Qatar
[3] Peking Univ, Coll Engn, Dept Adv Mfg & Robot, State Key Lab Turbulence & Complex Syst, Beijing 100871, Peoples R China
[4] Peking Univ, Nanchang Innovat Inst, Nanchang 330224, Peoples R China
关键词
l(1) regularization; finite-time stability (FTS); fixed-time stability (FxTS); locally competitive algorithm (LCA); sparse optimization; SIGNAL RECONSTRUCTION; RECOVERY; PROJECTION;
D O I
10.1109/TSMC.2023.3304850
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sparse optimization problems have been successfully applied to a wide range of research areas, and useful insights and elegant methods for proving the stability and convergence of neurodynamic algorithms have been yielded in previous work. This article develops several neurodynamic algorithms for sparse signal recovery by solving the l(1) regularization problem. First, in the framework of the locally competitive algorithm (LCA), modified LCA (MLCA) with finite-time convergence and MLCA with fixed-time convergence are designed. Then, the sliding-mode control (SMC) technique is introduced and modified, i.e., modified SMC (MSMC), which is combined with LCA to design MSMC-LCA with finite-time convergence and MSMC-LCA with fixed-time convergence. It is shown that the solutions of the proposed neurodynamic algorithms exist and are unique under the observation matrix satisfying restricted isometry property (RIP) condition, while finite-time or fixed-time convergence to the optimal points is shown via Lyapunov-based analysis. In addition, combining the notions of finite-time stability (FTS) and fixed-time stability (FxTS), upper bounds on the convergence time of the proposed neurodynamic algorithms are given, and the convergence results obtained for the MLCA and MSMC-LCA with fixed-time convergence are shown to be independent of the initial conditions. Finally, simulation experiments of signal recovery and image recovery are carried out to demonstrate the superior performance of the proposed neurodynamic algorithms.
引用
收藏
页码:131 / 142
页数:12
相关论文
共 50 条
  • [1] Neurodynamic optimization approaches with finite/fixed-time convergence for absolute value equations
    Ju, Xingxing
    Yang, Xinsong
    Feng, Gang
    Che, Hangjun
    NEURAL NETWORKS, 2023, 165 : 971 - 981
  • [2] Time-varying neurodynamic optimization approaches with fixed-time convergence for sparse signal reconstruction
    Ju, Xingxing
    Yang, Xinsong
    Qing, Linbo
    Cao, Jinde
    Wang, Dianwei
    NEUROCOMPUTING, 2024, 597
  • [3] FPGA Implementation for Finite-Time and Fixed-Time Neurodynamic Algorithms in Constrained Optimization Problems
    Zhang, Jiahao
    He, Xing
    Zhao, Gui
    Huang, Tingwen
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2023, 70 (09) : 3584 - 3597
  • [4] Fixed-Time Neurodynamic Optimization Algorithms and Application to Circuits Design
    Ju, Xingxing
    Yuan, Shuang
    Yang, Xinsong
    Shi, Peng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2024, 71 (05) : 2171 - 2181
  • [5] Matrix Neurodynamic Approaches for Rank Minimization: Finite/Fixed-Time Convergence Technique
    Zhang, Meng
    He, Xing
    Huang, Tingwen
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024,
  • [6] Fixed-Time Stable Neurodynamic Flow to Sparse Signal Recovery via Nonconvex L1-β2-Norm
    Zhao, You
    Liao, Xiaofeng
    He, Xing
    NEURAL COMPUTATION, 2022, 34 (08) : 1727 - 1755
  • [7] Sparse portfolio optimization via l1 over l2 regularization
    Wu, Zhongming
    Sun, Kexin
    Ge, Zhili
    Allen-Zhao, Zhihua
    Zeng, Tieyong
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2024, 319 (03) : 820 - 833
  • [8] Finite- and fixed-time convergent algorithms: Design and convergence time estimation
    Basin, Michael
    ANNUAL REVIEWS IN CONTROL, 2019, 48 : 209 - 221
  • [9] Time-Varying Parameter Identification Algorithms: Finite and Fixed-Time Convergence
    Rios, Hector
    Efimov, Denis
    Moreno, Jaime A.
    Perruquetti, Wilfrid
    Rueda-Escobedo, Juan G.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2017, 62 (07) : 3671 - 3678
  • [10] A Simple Neural Network for Sparse Optimization With l1 Regularization
    Ma, Litao
    Bian, Wei
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2021, 8 (04): : 3430 - 3442