A fast algorithm for group square-root Lasso based group-sparse regression

被引:3
|
作者
Zhao, Chunlei [1 ]
Mao, Xingpeng [1 ,2 ]
Chen, Minqiu [1 ]
Yu, Changjun [2 ,3 ]
机构
[1] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
[2] Minist Ind & Informat Technol, Key Lab Marine Environm Monitoring & Informat Pro, Harbin 150001, Peoples R China
[3] Harbin Inst Technol Weihai, Sch Informat & Elect Engn, Weihai 264209, Peoples R China
基金
中国国家自然科学基金;
关键词
Compressive sensing; Group-sparse; Linear regression; Square-root Lasso; Non-smooth convex optimization; DESCENT METHOD; SPICE; SELECTION; RECOVERY; BENEFIT; HYBRID;
D O I
10.1016/j.sigpro.2021.108142
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Group square-root Lasso (GSRL) is a promising tool for group-sparse regression since the hyperparameter is independent of noise level. Recent works also reveal its connections to some statistically sound and hyperparameter-free methods, e.g., group-sparse iterative covariance-based estimation (GSPICE). However, the non-smoothness of the data-fitting term leads to the difficulty in solving the optimization problem of GSRL, and available solvers usually suffer either slow convergence or restrictions on the dictionary. In this paper, we propose a class of efficient solvers for GSRL in a block coordinate descent manner, including group-wise cyclic minimization (GCM) for group-wise orthonormal dictionary and generalized GCM (G-GCM) for general dictionary. Both strict descent property and global convergence are proved. To cope with signal processing applications, the complex-valued multiple measurement vectors (MMV) case is considered. The proposed algorithm can also be used for the fast implementation of methods with theoretical equivalence to GSRL, e.g., GSPICE. Significant superiority in computational efficiency is verified by simulation results. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Square-Root LASSO for High-Dimensional Sparse Linear Systems with Weakly Dependent Errors
    Xie, Fang
    Xiao, Zhijie
    JOURNAL OF TIME SERIES ANALYSIS, 2018, 39 (02) : 212 - 238
  • [32] Sparse group lasso for multiclass functional logistic regression models
    Matsui, Hidetoshi
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2019, 48 (06) : 1784 - 1797
  • [33] Fast Square-Root Detection Algorithm for V-BLAST
    Wang, Yun
    Wang, Jinkuan
    2007 INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING, VOLS 1-15, 2007, : 1340 - 1343
  • [34] Seagull: lasso, group lasso and sparse-group lasso regularization for linear regression models via proximal gradient descent
    Jan Klosa
    Noah Simon
    Pål Olof Westermark
    Volkmar Liebscher
    Dörte Wittenburg
    BMC Bioinformatics, 21
  • [35] Seagull: lasso, group lasso and sparse-group lasso regularization for linear regression models via proximal gradient descent
    Klosa, Jan
    Simon, Noah
    Westermark, Pal Olof
    Liebscher, Volkmar
    Wittenburg, Doerte
    BMC BIOINFORMATICS, 2020, 21 (01)
  • [36] Robust sketching for multiple square-root LASSO problems
    Vu Pham
    El Ghaoui, Laurent
    ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 38, 2015, 38 : 753 - 761
  • [37] Square-Root Lasso With Nonconvex Regularization: An ADMM Approach
    Shen, Xinyue
    Chen, Laming
    Gu, Yuantao
    So, H. C.
    IEEE SIGNAL PROCESSING LETTERS, 2016, 23 (07) : 934 - 938
  • [38] Multivariate group-sparse mode decomposition
    Mourad, Nasser
    DIGITAL SIGNAL PROCESSING, 2023, 137
  • [39] Multivariate sparse group lasso for the multivariate multiple linear regression with an arbitrary group structure
    Li, Yanming
    Nan, Bin
    Zhu, Ji
    BIOMETRICS, 2015, 71 (02) : 354 - 363
  • [40] A group lasso based sparse KNN classifier
    Zheng, Shuai
    Ding, Chris
    PATTERN RECOGNITION LETTERS, 2020, 131 (131) : 227 - 233