Comparing Bayesian Variable Selection to Lasso Approaches for Applications in Psychology

被引:2
|
作者
Bainter, Sierra A. [1 ,4 ]
McCauley, Thomas G. [2 ]
Fahmy, Mahmoud M. [1 ]
Goodman, Zachary T. [1 ]
Kupis, Lauren B. [3 ]
Rao, J. Sunil [1 ]
机构
[1] Univ Miami, Miami, FL USA
[2] Univ Calif San Diego, San Diego, CA 92110 USA
[3] Univ Calif Los Angeles, Los Angeles, CA USA
[4] Univ Miami, Dept Psychol, 5665 Poncede Leon Blvd, Coral Gables, FL 33146 USA
关键词
Bayesian; regression; lasso; variable selection; penalization; shrinkage priors; stochastic search variable selection; MAJOR DEPRESSIVE DISORDER; REGRESSION SHRINKAGE; STEPWISE REGRESSION; MODEL; REGULARIZATION; QUESTIONNAIRE; PERSONALITY; IMPULSIVITY; PREDICTION; ANXIETY;
D O I
10.1007/s11336-023-09914-9
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
In the current paper, we review existing tools for solving variable selection problems in psychology. Modern regularization methods such as lasso regression have recently been introduced in the field and are incorporated into popular methodologies, such as network analysis. However, several recognized limitations of lasso regularization may limit its suitability for psychological research. In this paper, we compare the properties of lasso approaches used for variable selection to Bayesian variable selection approaches. In particular we highlight advantages of stochastic search variable selection (SSVS), that make it well suited for variable selection applications in psychology. We demonstrate these advantages and contrast SSVS with lasso type penalization in an application to predict depression symptoms in a large sample and an accompanying simulation study. We investigate the effects of sample size, effect size, and patterns of correlation among predictors on rates of correct and false inclusion and bias in the estimates. SSVS as investigated here is reasonably computationally efficient and powerful to detect moderate effects in small sample sizes (or small effects in moderate sample sizes), while protecting against false inclusion and without over-penalizing true effects. We recommend SSVS as a flexible framework that is well-suited for the field, discuss limitations, and suggest directions for future development.
引用
收藏
页码:1032 / 1055
页数:24
相关论文
共 50 条
  • [21] Ordered homogeneity pursuit lasso for group variable selection with applications to spectroscopic data
    Lin, You-Wu
    Xiao, Nan
    Wang, Li-Li
    Li, Chuan-Quan
    Xu, Qing-Song
    [J]. CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2017, 168 : 62 - 71
  • [22] Dose individualization and variable selection by using the Bayesian lasso in early phase dose finding trials
    Kakurai, Yasuyuki
    Kaneko, Shuhei
    Hamada, Chikuma
    Hirakawa, Akihiro
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES C-APPLIED STATISTICS, 2019, 68 (02) : 445 - 460
  • [23] Bayesian approaches to variable selection in mixture models with application to disease clustering
    Lu, Zihang
    Lou, Wendy
    [J]. JOURNAL OF APPLIED STATISTICS, 2023, 50 (02) : 387 - 407
  • [24] Comparing Model Selection and Regularization Approaches to Variable Selection in Model-Based Clustering
    Celeux, Gilles
    Martin-Magniette, Marie-Laure
    Maugis-Rabusseau, Cathy
    Raftery, Adrian E.
    [J]. JOURNAL OF THE SFDS, 2014, 155 (02): : 57 - 71
  • [25] Incorporating Grouping Information in Bayesian Variable Selection with Applications in Genomics
    Rockova, Veronika
    Lesaffre, Emmanuel
    [J]. BAYESIAN ANALYSIS, 2014, 9 (01): : 221 - 257
  • [26] Bayesian approaches to variable selection: a comparative study from practical perspectives
    Lu, Zihang
    Lou, Wendy
    [J]. INTERNATIONAL JOURNAL OF BIOSTATISTICS, 2022, 18 (01): : 83 - 108
  • [27] Bayesian Variable Selection
    Sutton, Matthew
    [J]. CASE STUDIES IN APPLIED BAYESIAN DATA SCIENCE: CIRM JEAN-MORLET CHAIR, FALL 2018, 2020, 2259 : 121 - 135
  • [28] Accounting for clustering in automated variable selection using hospital data: a comparison of different LASSO approaches
    Stella Bollmann
    Andreas Groll
    Michael M. Havranek
    [J]. BMC Medical Research Methodology, 23
  • [29] Variable Selection by Lasso-Type Methods
    Chand, Sohail
    Kamal, Shahid
    [J]. PAKISTAN JOURNAL OF STATISTICS AND OPERATION RESEARCH, 2011, 7 (02) : 451 - 464
  • [30] Accounting for clustering in automated variable selection using hospital data: a comparison of different LASSO approaches
    Bollmann, Stella
    Groll, Andreas
    Havranek, Michael M.
    [J]. BMC MEDICAL RESEARCH METHODOLOGY, 2023, 23 (01)