Approximate Post-Selective Inference for Regression with the Group LASSO

被引:0
|
作者
Panigrahi, Snigdha [1 ]
MacDonald, Peter W. [1 ]
Kessler, Daniel [2 ]
机构
[1] Univ Michigan, Dept Stat, Ann Arbor, MI 48109 USA
[2] Univ Michigan, Dept Psychiat, Ann Arbor, MI 48109 USA
基金
美国国家科学基金会;
关键词
Conditional inference; Group sparsity; Group LASSO; Laplace approxima; tion; Selective inference;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
After selection with the Group LASSO (or generalized variants such as the overlapping, sparse, or standardized Group LASSO), inference for the selected parameters is unreliable in the absence of adjustments for selection bias. In the penalized Gaussian regression setup, existing approaches provide adjustments for selection events that can be expressed as linear inequalities in the data variables. Such a representation, however, fails to hold for selection with the Group LASSO and substantially obstructs the scope of subsequent post-selective inference. Key questions of inferential interest-for example, inference for the effects of selected variables on the outcome-remain unanswered. In the present paper, we develop a consistent, post-selective, Bayesian method to address the existing gaps by deriving a likelihood adjustment factor and an approximation thereof that eliminates bias from the selection of groups. Experiments on simulated data and data from the Human Connectome Project demonstrate that our method recovers the effects of parameters within the selected groups while paying only a small price for bias adjustment.
引用
收藏
页数:49
相关论文
共 50 条
  • [21] Variational inference on a Bayesian adaptive lasso Tobit quantile regression model
    Wang, Zhiqiang
    Wu, Ying
    Cheng, WeiLi
    STAT, 2023, 12 (01):
  • [22] The benefit of group sparsity in group inference with de-biased scaled group Lasso
    Mitra, Ritwik
    Zhang, Cun-Hui
    ELECTRONIC JOURNAL OF STATISTICS, 2016, 10 (02): : 1829 - 1873
  • [23] ProteinLasso: A Lasso regression approach to protein inference problem in shotgun proteomics
    Huang, Ting
    Gong, Haipeng
    Yang, Can
    He, Zengyou
    COMPUTATIONAL BIOLOGY AND CHEMISTRY, 2013, 43 : 46 - 54
  • [24] SLICED INVERSE REGRESSION (SIR) WITH ROBUST GROUP LASSO
    Al-Sabbah, Shrook A. S.
    Mohammed, Laith Ali
    Raheem, Saif Hosam
    INTERNATIONAL JOURNAL OF AGRICULTURAL AND STATISTICAL SCIENCES, 2021, 17 (01): : 359 - 363
  • [25] Robust group-Lasso for functional regression model
    Pannu, Jasdeep
    Billor, Nedret
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2017, 46 (05) : 3356 - 3374
  • [26] Approximate Selective Inference via Maximum Likelihood
    Panigrahi, Snigdha
    Taylor, Jonathan
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2023, 118 (544) : 2810 - 2820
  • [27] Exact post-selection inference for the generalized lasso path
    Hyun, Sangwon
    G'Sell, Max
    Tibshirani, Ryan J.
    ELECTRONIC JOURNAL OF STATISTICS, 2018, 12 (01): : 1053 - 1097
  • [28] Approximate Inference for Fully Bayesian Gaussian Process Regression
    Lalchand, Vidhi
    Rasmussen, Carl Edward
    SYMPOSIUM ON ADVANCES IN APPROXIMATE BAYESIAN INFERENCE, VOL 118, 2019, 118
  • [30] Regularized group regression methods for genomic prediction: Bridge, MCP, SCAD, group bridge, group lasso, sparse group lasso, group MCP and group SCAD
    Joseph O Ogutu
    Hans-Peter Piepho
    BMC Proceedings, 8 (Suppl 5)