A fast algorithm for group square-root Lasso based group-sparse regression

被引:3
|
作者
Zhao, Chunlei [1 ]
Mao, Xingpeng [1 ,2 ]
Chen, Minqiu [1 ]
Yu, Changjun [2 ,3 ]
机构
[1] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
[2] Minist Ind & Informat Technol, Key Lab Marine Environm Monitoring & Informat Pro, Harbin 150001, Peoples R China
[3] Harbin Inst Technol Weihai, Sch Informat & Elect Engn, Weihai 264209, Peoples R China
基金
中国国家自然科学基金;
关键词
Compressive sensing; Group-sparse; Linear regression; Square-root Lasso; Non-smooth convex optimization; DESCENT METHOD; SPICE; SELECTION; RECOVERY; BENEFIT; HYBRID;
D O I
10.1016/j.sigpro.2021.108142
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Group square-root Lasso (GSRL) is a promising tool for group-sparse regression since the hyperparameter is independent of noise level. Recent works also reveal its connections to some statistically sound and hyperparameter-free methods, e.g., group-sparse iterative covariance-based estimation (GSPICE). However, the non-smoothness of the data-fitting term leads to the difficulty in solving the optimization problem of GSRL, and available solvers usually suffer either slow convergence or restrictions on the dictionary. In this paper, we propose a class of efficient solvers for GSRL in a block coordinate descent manner, including group-wise cyclic minimization (GCM) for group-wise orthonormal dictionary and generalized GCM (G-GCM) for general dictionary. Both strict descent property and global convergence are proved. To cope with signal processing applications, the complex-valued multiple measurement vectors (MMV) case is considered. The proposed algorithm can also be used for the fast implementation of methods with theoretical equivalence to GSRL, e.g., GSPICE. Significant superiority in computational efficiency is verified by simulation results. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] HILBERT MODULAR GROUP FOR FIELD Q SQUARE-ROOT OF 13
    VANDERGEER, G
    ZAGIER, D
    INVENTIONES MATHEMATICAE, 1977, 42 : 93 - 133
  • [42] A fast square-root implementation for BLAST
    Hassibi, B
    CONFERENCE RECORD OF THE THIRTY-FOURTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, 2000, : 1255 - 1259
  • [43] A Sparse-Group Lasso
    Simon, Noah
    Friedman, Jerome
    Hastie, Trevor
    Tibshirani, Robert
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2013, 22 (02) : 231 - 245
  • [44] Classification With the Sparse Group Lasso
    Rao, Nikhil
    Nowak, Robert
    Cox, Christopher
    Rogers, Timothy
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2016, 64 (02) : 448 - 463
  • [45] Tensor Completion via Group-Sparse Regularization
    Yang, Bo
    Wang, Gang
    Sidiropoulos, Nicholas D.
    2016 50TH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS AND COMPUTERS, 2016, : 1750 - 1754
  • [46] On Regularized Square-root Regression Problems: Distributionally Robust Interpretation and Fast Computations
    Chu, Hong T.M.
    Toh, Kim-Chuan
    Zhang, Yangjing
    Journal of Machine Learning Research, 2022, 23
  • [47] Selective inference with unknown variance via the square-root lasso
    Tian, Xiaoying
    Loftus, Joshua R.
    Taylor, Jonathan E.
    BIOMETRIKA, 2018, 105 (04) : 755 - 768
  • [48] GPR Clutter Removal Based on Factor Group-Sparse Regularization
    Liu, Li
    Wu, Zezhou
    Xu, Hang
    Wang, Bingjie
    Li, Jingxia
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [49] On Regularized Square-root Regression Problems: Distributionally Robust Interpretation and Fast Computations
    Chu, Hong T. M.
    Toh, Kim-Chuan
    Zhang, Yangjing
    JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [50] Robust and Tuning-Free Sparse Linear Regression via Square-Root Slope
    Minsker, Stanislav
    Ndaoud, Mohamed
    Wang, Lang
    SIAM JOURNAL ON MATHEMATICS OF DATA SCIENCE, 2024, 6 (02): : 428 - 453