Introduction to variational Bayes for high-dimensional linear and logistic regression models

被引:0
|
作者
Jang, Insong [1 ]
Lee, Kyoungjae [2 ]
机构
[1] Inha Univ, Dept Stat, Incheon, South Korea
[2] Sungkyunkwan Univ, Dept Stat, 25-2 Sungkyunkwan Ro, Seoul 03063, South Korea
关键词
variable selection; regression model; spike and slab prior; horseshoe prior; VARIABLE SELECTION;
D O I
10.5351/KJAS.2022.35.3.445
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this paper, we introduce existing Bayesian methods for high-dimensional sparse regression models and compare their performance in various simulation scenarios. Especially, we focus on the variational Bayes ap-proach proposed by Ray and Szabo?? (2021), which enables scalable and accurate Bayesian inference. Based on simulated data sets from sparse high-dimensional linear regression models, we compare the variational Bayes approach with other Bayesian and frequentist methods. To check the practical performance of the variational Bayes in logistic regression models, a real data analysis is conducted using leukemia data set.
引用
收藏
页码:445 / 455
页数:11
相关论文
共 50 条
  • [1] Variational Bayes for High-Dimensional Linear Regression With Sparse Priors
    Ray, Kolyan
    Szabo, Botond
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2022, 117 (539) : 1270 - 1281
  • [2] Scalable and accurate variational Bayes for high-dimensional binary regression models
    Fasano, Augusto
    Durante, Daniele
    Zanella, Giacomo
    [J]. BIOMETRIKA, 2022, 109 (04) : 901 - 919
  • [3] Spike and slab variational Bayes for high dimensional logistic regression
    Ray, Kolyan
    Szabo, Botond
    Clara, Gabriel
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [4] Variational Inference in high-dimensional linear regression
    Mukherjee, Sumit
    Sen, Subhabrata
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [5] Variational Bayes for high-dimensional linear regression with sparse priors (Jan, 10.1080/01621459.2020.1847121, 2021)
    Ray, Kolyan
    Szabo, Botond
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2021, 116 (535) : 1560 - 1560
  • [6] Weak Signals in High-Dimensional Logistic Regression Models
    Reangsephet, Orawan
    Lisawadi, Supranee
    Ahmed, Syed Ejaz
    [J]. PROCEEDINGS OF THE THIRTEENTH INTERNATIONAL CONFERENCE ON MANAGEMENT SCIENCE AND ENGINEERING MANAGEMENT, VOL 1, 2020, 1001 : 121 - 133
  • [7] On inference in high-dimensional logistic regression models with separated data
    Lewis, R. M.
    Battey, H. S.
    [J]. BIOMETRIKA, 2024, 111 (03)
  • [8] Classification of High-Dimensional Data with Ensemble of Logistic Regression Models
    Lim, Noha
    Ahn, Hongshik
    Moon, Hojin
    Chen, James J.
    [J]. JOURNAL OF BIOPHARMACEUTICAL STATISTICS, 2010, 20 (01) : 160 - 171
  • [9] Bayesian adaptive lasso with variational Bayes for variable selection in high-dimensional generalized linear mixed models
    Dao Thanh Tung
    Minh-Ngoc Tran
    Tran Manh Cuong
    [J]. COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2019, 48 (02) : 530 - 543
  • [10] Empirical likelihood for high-dimensional linear regression models
    Hong Guo
    Changliang Zou
    Zhaojun Wang
    Bin Chen
    [J]. Metrika, 2014, 77 : 921 - 945