Group-sparse regression using the covariance fitting criterion

被引:14
|
作者
Kronvall, Ted [1 ]
Adalbjornsson, Stefan Ingi [1 ]
Nadig, Santhosh [1 ]
Jakobsson, Andreas [1 ]
机构
[1] Lund Univ, Dept Math Stat, Lund, Sweden
基金
瑞典研究理事会;
关键词
Covariance fitting; SPICE; Group sparsity; Group-LASSO; Hyperparameter-free; Convex optimization; VARIABLE SELECTION; SIGNAL RECONSTRUCTION; PARAMETER-ESTIMATION; RECOVERY; REPRESENTATIONS; DECOMPOSITION; ESTIMATOR; SPICE;
D O I
10.1016/j.sigpro.2017.03.025
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this work, we present a novel formulation for efficient estimation of group-sparse regression problems. By relaxing a covariance fitting criteria commonly used in array signal processing, we derive a generalization of the recent SPICE method for grouped variables. Such a formulation circumvents cumbersome model order estimation, while being inherently hyperparameter-free. We derive an implementation which iteratively decomposes into a series of convex optimization problems, each being solvable in closed-form. Furthermore, we show the connection between the proposed estimator and the class of LASSO-type estimators, where a dictionary-dependent regularization level is inherently set by the covariance fitting criteria. We also show how the proposed estimator may be used to form group-sparse estimates for sparse groups, as well as validating its robustness against coherency in the dictionary, i.e., the case of overlapping dictionary groups. Numerical results show preferable estimation performance, on par with a group-LASSO bestowed with oracle regularization, and well exceeding comparable greedy estimation methods. (C) 2017 Published by Elsevier B.V.
引用
收藏
页码:116 / 130
页数:15
相关论文
共 50 条
  • [31] Enhanced-resolution SAR tomography using the weighted covariance fitting criterion
    Martin-del-Campo-Becerra, Gustavo Daniel
    Reigber, Andreas
    Nannini, Matteo
    13TH EUROPEAN CONFERENCE ON SYNTHETIC APERTURE RADAR, EUSAR 2021, 2021, : 66 - 70
  • [32] Underdetermined DOA Estimation for Wideband Signals Using Robust Sparse Covariance Fitting
    He, Zhen-Qing
    Shi, Zhi-Ping
    Huang, Lei
    So, Hing Cheung
    IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (04) : 435 - 439
  • [33] Regularized Linear Regression via Covariance Fitting
    Mattsson, Per
    Zachariah, Dave
    Stoica, Petre
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2023, 71 : 1175 - 1183
  • [34] A Novel Generalized Group-Sparse Mixture Adaptive Filtering Algorithm
    Li, Yingsong
    Cherednichenko, Aleksey
    Jiang, Zhengxiong
    Shi, Wanlu
    Wu, Jinqiu
    SYMMETRY-BASEL, 2019, 11 (05):
  • [35] Fast Regularized Discrete Optimal Transport with Group-Sparse Regularizers
    Ida, Yasutoshi
    Kanai, Sekitoshi
    Adachi, Kazuki
    Kumagai, Atsutoshi
    Fujiwara, Yasuhiro
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 7, 2023, : 7980 - 7987
  • [36] MARKOV-TREE BAYESIAN GROUP-SPARSE MODELING WITH WAVELETS
    Zhang, Ganchi
    Kingsbury, Nick
    2016 IEEE STATISTICAL SIGNAL PROCESSING WORKSHOP (SSP), 2016,
  • [37] GPR Clutter Removal Based on Factor Group-Sparse Regularization
    Liu, Li
    Wu, Zezhou
    Xu, Hang
    Wang, Bingjie
    Li, Jingxia
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [38] Learning Macroscopic Brain Connectomes via Group-Sparse Factorization
    Aminmansour, Farzane
    Patterson, Andrew
    Le, Lei
    Peng, Yisu
    Mitchell, Daniel
    Pestilli, Franco
    Caiafa, Cesar
    Greiner, Russell
    White, Martha
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [39] An enhanced proportionate NLMF algorithm for group-sparse system identification
    Jiang, Zhengxiong
    Shi, Wanlu
    Huang, Xinqi
    Li, Yingsong
    AEU-INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATIONS, 2020, 119
  • [40] Group-Sparse Matrix Factorization for Transfer Learning of Word Embeddings
    Xu, Kan
    Zhao, Xuanyi
    Bastani, Hamsa
    Bastani, Osbert
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139