Group-sparse regression using the covariance fitting criterion

被引:14
|
作者
Kronvall, Ted [1 ]
Adalbjornsson, Stefan Ingi [1 ]
Nadig, Santhosh [1 ]
Jakobsson, Andreas [1 ]
机构
[1] Lund Univ, Dept Math Stat, Lund, Sweden
基金
瑞典研究理事会;
关键词
Covariance fitting; SPICE; Group sparsity; Group-LASSO; Hyperparameter-free; Convex optimization; VARIABLE SELECTION; SIGNAL RECONSTRUCTION; PARAMETER-ESTIMATION; RECOVERY; REPRESENTATIONS; DECOMPOSITION; ESTIMATOR; SPICE;
D O I
10.1016/j.sigpro.2017.03.025
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this work, we present a novel formulation for efficient estimation of group-sparse regression problems. By relaxing a covariance fitting criteria commonly used in array signal processing, we derive a generalization of the recent SPICE method for grouped variables. Such a formulation circumvents cumbersome model order estimation, while being inherently hyperparameter-free. We derive an implementation which iteratively decomposes into a series of convex optimization problems, each being solvable in closed-form. Furthermore, we show the connection between the proposed estimator and the class of LASSO-type estimators, where a dictionary-dependent regularization level is inherently set by the covariance fitting criteria. We also show how the proposed estimator may be used to form group-sparse estimates for sparse groups, as well as validating its robustness against coherency in the dictionary, i.e., the case of overlapping dictionary groups. Numerical results show preferable estimation performance, on par with a group-LASSO bestowed with oracle regularization, and well exceeding comparable greedy estimation methods. (C) 2017 Published by Elsevier B.V.
引用
收藏
页码:116 / 130
页数:15
相关论文
共 50 条
  • [1] ONLINE GROUP-SPARSE ESTIMATION USING THE COVARIANCE FITTING CRITERION
    Kronvall, Ted
    Adalbjornsson, Stefan Ingi
    Nadig, Santhosh
    Jakobsson, Andreas
    2017 25TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2017, : 2101 - 2105
  • [2] Hyperparameter selection for group-sparse regression: A probabilistic approach
    Kronvall, Ted
    Jakobsson, Andreas
    SIGNAL PROCESSING, 2018, 151 : 107 - 118
  • [3] The knockoff filter for FDR control in group-sparse and multitask regression
    Dai, Ran
    Barber, Rina Foygel
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 48, 2016, 48
  • [4] GROUP-SPARSE MATRIX RECOVERY
    Zeng, Xiangrong
    Figueiredo, Mario A. T.
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [5] A fast algorithm for group square-root Lasso based group-sparse regression
    Zhao, Chunlei
    Mao, Xingpeng
    Chen, Minqiu
    Yu, Changjun
    SIGNAL PROCESSING, 2021, 187
  • [6] Multivariate group-sparse mode decomposition
    Mourad, Nasser
    DIGITAL SIGNAL PROCESSING, 2023, 137
  • [7] Target Detection and Interference Cancellation in Passive Radar Sensors via Group-Sparse Regression
    Nikaein, Hossein
    Zefreh, Reza Ghaderi
    Gazor, Saeed
    IEEE SENSORS JOURNAL, 2023, 23 (18) : 21484 - 21492
  • [8] MULTI-SOURCE DIRECTION-OF-ARRIVAL ESTIMATION USING GROUP-SPARSE FITTING OF STEERED RESPONSE POWER MAPS
    Tengan, Elisa
    Dietzen, Thomas
    Elvander, Filip
    van Waterschoot, Toon
    2023 IEEE WORKSHOP ON APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS, WASPAA, 2023,
  • [9] Efficient direction of arrival estimation based on sparse covariance fitting criterion with modeling mismatch
    Cai, Shu
    Wang, Gang
    Zhang, Jun
    Wong, Kai-Kit
    Zhu, Hongbo
    SIGNAL PROCESSING, 2017, 137 : 264 - 273
  • [10] Supervised speech enhancement using online Group-Sparse Convolutive NMF
    Yousefi, Midia
    Savoji, Mohammad Hassan
    2016 8TH INTERNATIONAL SYMPOSIUM ON TELECOMMUNICATIONS (IST), 2016, : 494 - 499