A fast algorithm for group square-root Lasso based group-sparse regression

被引:3
|
作者
Zhao, Chunlei [1 ]
Mao, Xingpeng [1 ,2 ]
Chen, Minqiu [1 ]
Yu, Changjun [2 ,3 ]
机构
[1] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
[2] Minist Ind & Informat Technol, Key Lab Marine Environm Monitoring & Informat Pro, Harbin 150001, Peoples R China
[3] Harbin Inst Technol Weihai, Sch Informat & Elect Engn, Weihai 264209, Peoples R China
基金
中国国家自然科学基金;
关键词
Compressive sensing; Group-sparse; Linear regression; Square-root Lasso; Non-smooth convex optimization; DESCENT METHOD; SPICE; SELECTION; RECOVERY; BENEFIT; HYBRID;
D O I
10.1016/j.sigpro.2021.108142
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Group square-root Lasso (GSRL) is a promising tool for group-sparse regression since the hyperparameter is independent of noise level. Recent works also reveal its connections to some statistically sound and hyperparameter-free methods, e.g., group-sparse iterative covariance-based estimation (GSPICE). However, the non-smoothness of the data-fitting term leads to the difficulty in solving the optimization problem of GSRL, and available solvers usually suffer either slow convergence or restrictions on the dictionary. In this paper, we propose a class of efficient solvers for GSRL in a block coordinate descent manner, including group-wise cyclic minimization (GCM) for group-wise orthonormal dictionary and generalized GCM (G-GCM) for general dictionary. Both strict descent property and global convergence are proved. To cope with signal processing applications, the complex-valued multiple measurement vectors (MMV) case is considered. The proposed algorithm can also be used for the fast implementation of methods with theoretical equivalence to GSRL, e.g., GSPICE. Significant superiority in computational efficiency is verified by simulation results. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] The Group Square-Root Lasso: Theoretical Properties and Fast Algorithms
    Bunea, Florentina
    Lederer, Johannes
    She, Yiyuan
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (02) : 1313 - 1325
  • [2] Group sparse recovery via group square-root elastic net and the iterative multivariate thresholding-based algorithm
    Xie, Wanling
    Yang, Hu
    ASTA-ADVANCES IN STATISTICAL ANALYSIS, 2023, 107 (03) : 469 - 507
  • [3] Group sparse recovery via group square-root elastic net and the iterative multivariate thresholding-based algorithm
    Wanling Xie
    Hu Yang
    AStA Advances in Statistical Analysis, 2023, 107 : 469 - 507
  • [4] The Square-Root Lasso
    van de Geer, Sara
    ESTIMATION AND TESTING UNDER SPARSITY: ECOLE D'ETE DE PROBABILITES DE SAINT-FLOUR XLV - 2015, 2016, 2159 : 27 - 39
  • [5] Fast Sparse Group Lasso
    Ida, Yasutoshi
    Fujiwara, Yasuhiro
    Kashima, Hisashi
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [6] Improved bounds for Square-Root Lasso and Square-Root Slope
    Derumigny, Alexis
    ELECTRONIC JOURNAL OF STATISTICS, 2018, 12 (01): : 741 - 766
  • [7] SQUARE-ROOT ALGORITHM IS FAST AND SIMPLE
    GRAPPEL, RD
    EDN, 1986, 31 (08) : 246 - &
  • [8] PIVOTAL ESTIMATION VIA SQUARE-ROOT LASSO IN NONPARAMETRIC REGRESSION
    Belloni, Alexandre
    Chernozhukov, Victor
    Wang, Lie
    ANNALS OF STATISTICS, 2014, 42 (02): : 757 - 788
  • [9] SQUARE-ROOT ALGORITHM IS FAST AND SIMPLE
    GRAPPEL, RD
    EDN, 1988, 33 (15A) : 144 - &
  • [10] Connection between SPICE and Square-Root LASSO for sparse parameter estimation
    Babu, Prabhu
    Stoica, Petre
    SIGNAL PROCESSING, 2014, 95 : 10 - 14