A fast algorithm for group square-root Lasso based group-sparse regression

被引:3
|
作者
Zhao, Chunlei [1 ]
Mao, Xingpeng [1 ,2 ]
Chen, Minqiu [1 ]
Yu, Changjun [2 ,3 ]
机构
[1] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Peoples R China
[2] Minist Ind & Informat Technol, Key Lab Marine Environm Monitoring & Informat Pro, Harbin 150001, Peoples R China
[3] Harbin Inst Technol Weihai, Sch Informat & Elect Engn, Weihai 264209, Peoples R China
基金
中国国家自然科学基金;
关键词
Compressive sensing; Group-sparse; Linear regression; Square-root Lasso; Non-smooth convex optimization; DESCENT METHOD; SPICE; SELECTION; RECOVERY; BENEFIT; HYBRID;
D O I
10.1016/j.sigpro.2021.108142
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Group square-root Lasso (GSRL) is a promising tool for group-sparse regression since the hyperparameter is independent of noise level. Recent works also reveal its connections to some statistically sound and hyperparameter-free methods, e.g., group-sparse iterative covariance-based estimation (GSPICE). However, the non-smoothness of the data-fitting term leads to the difficulty in solving the optimization problem of GSRL, and available solvers usually suffer either slow convergence or restrictions on the dictionary. In this paper, we propose a class of efficient solvers for GSRL in a block coordinate descent manner, including group-wise cyclic minimization (GCM) for group-wise orthonormal dictionary and generalized GCM (G-GCM) for general dictionary. Both strict descent property and global convergence are proved. To cope with signal processing applications, the complex-valued multiple measurement vectors (MMV) case is considered. The proposed algorithm can also be used for the fast implementation of methods with theoretical equivalence to GSRL, e.g., GSPICE. Significant superiority in computational efficiency is verified by simulation results. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] GROUP-SPARSE MATRIX RECOVERY
    Zeng, Xiangrong
    Figueiredo, Mario A. T.
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [22] Fast Regularized Discrete Optimal Transport with Group-Sparse Regularizers
    Ida, Yasutoshi
    Kanai, Sekitoshi
    Adachi, Kazuki
    Kumagai, Atsutoshi
    Fujiwara, Yasuhiro
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 7, 2023, : 7980 - 7987
  • [23] New Insights for the Multivariate Square-Root Lasso
    Molstad, Aaron J.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [24] Group-sparse mode decomposition: A signal decomposition algorithm based on group-sparsity in the frequency domain
    Mourad, Nasser
    DIGITAL SIGNAL PROCESSING, 2022, 122
  • [25] A Novel Generalized Group-Sparse Mixture Adaptive Filtering Algorithm
    Li, Yingsong
    Cherednichenko, Aleksey
    Jiang, Zhengxiong
    Shi, Wanlu
    Wu, Jinqiu
    SYMMETRY-BASEL, 2019, 11 (05):
  • [26] Fast block coordinate descent for sparse group lasso
    Ida Y.
    Fujiwara Y.
    Kashima H.
    Transactions of the Japanese Society for Artificial Intelligence, 2021, 36 (01) : 1 - 11
  • [27] An Enhanced Extreme Learning Machine Based on Square-Root Lasso Method
    Murat Genç
    Neural Processing Letters, 56
  • [28] An enhanced proportionate NLMF algorithm for group-sparse system identification
    Jiang, Zhengxiong
    Shi, Wanlu
    Huang, Xinqi
    Li, Yingsong
    AEU-INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATIONS, 2020, 119
  • [29] Regularized group regression methods for genomic prediction: Bridge, MCP, SCAD, group bridge, group lasso, sparse group lasso, group MCP and group SCAD
    Joseph O Ogutu
    Hans-Peter Piepho
    BMC Proceedings, 8 (Suppl 5)
  • [30] An Enhanced Extreme Learning Machine Based on Square-Root Lasso Method
    Genc, Murat
    NEURAL PROCESSING LETTERS, 2024, 56 (01)