A Variant of AIC Based on the Bayesian Marginal Likelihood

被引:0
|
作者
Yuki Kawakubo
Tatsuya Kubokawa
Muni S. Srivastava
机构
[1] Chiba University,Graduate School of Social Sciences
[2] University of Tokyo,Faculty of Economics
[3] University of Toronto,Department of Statistics
关键词
AIC; BIC; Consistency; Kullback–Leibler divergence; Linear regression model; Residual information criterion; Variable selection; Primary 62J05; Secondary 62F12;
D O I
暂无
中图分类号
学科分类号
摘要
We propose information criteria that measure the prediction risk of a predictive density based on the Bayesian marginal likelihood from a frequentist point of view. We derive criteria for selecting variables in linear regression models, assuming a prior distribution of the regression coefficients. Then, we discuss the relationship between the proposed criteria and related criteria. There are three advantages of our method. First, this is a compromise between the frequentist and Bayesian standpoints because it evaluates the frequentist’s risk of the Bayesian model. Thus, it is less influenced by a prior misspecification. Second, the criteria exhibits consistency when selecting the true model. Third, when a uniform prior is assumed for the regression coefficients, the resulting criterion is equivalent to the residual information criterion (RIC) of Shi and Tsai (J. R. Stat. Soc. Ser. B64, 237–252 2002).
引用
收藏
页码:60 / 84
页数:24
相关论文
共 50 条
  • [1] A Variant of AIC Based on the Bayesian Marginal Likelihood
    Kawakubo, Yuki
    Kubokawa, Tatsuya
    Srivastava, Muni S.
    [J]. SANKHYA-SERIES B-APPLIED AND INTERDISCIPLINARY STATISTICS, 2018, 80 : 60 - 84
  • [2] Marginal Likelihood Based Model Comparison in Fuzzy Bayesian Learning
    Pan, Indranil
    Bester, Dirk
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2020, 4 (06): : 794 - 799
  • [3] Bayesian Model Selection, the Marginal Likelihood, and Generalization
    Lotfi, Sanae
    Izmailov, Pavel
    Benton, Gregory
    Goldblum, Micah
    Wilson, Andrew Gordon
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [4] Bayesian updating and marginal likelihood estimation by cross entropy based importance sampling
    Engel, Michael
    Kanjilal, Oindrila
    Papaioannou, Iason
    Straub, Daniel
    [J]. JOURNAL OF COMPUTATIONAL PHYSICS, 2023, 473
  • [5] Consensus Based Distributed Sparse Bayesian Learning by Fast Marginal Likelihood Maximization
    Manss, Christoph
    Shutin, Dmitriy
    Leus, Geert
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 2119 - 2123
  • [6] Marginal likelihood for a class of Bayesian generalized linear models
    Nandram, B
    Kim, H
    [J]. JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2002, 72 (04) : 319 - 340
  • [7] Bayesian Allocation Model: Marginal Likelihood-Based Model Selection for Count Tensors
    Yldrm, Sinan
    Kurutmaz, M. Burak
    Barsbey, Melih
    Simsekli, Umut
    Cemgil, A. Taylan
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2021, 15 (03) : 560 - 573
  • [8] An Approximate Bayesian Marginal Likelihood Approach for Estimating Finite Mixtures
    Martin, Ryan
    [J]. COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2013, 42 (07) : 1533 - 1548
  • [9] Improving Marginal Likelihood Estimation for Bayesian Phylogenetic Model Selection
    Xie, Wangang
    Lewis, Paul O.
    Fan, Yu
    Kuo, Lynn
    Chen, Ming-Hui
    [J]. SYSTEMATIC BIOLOGY, 2011, 60 (02) : 150 - 160
  • [10] Efficient approximations for the marginal likelihood of Bayesian networks with hidden variables
    Chickering, DM
    Heckerman, D
    [J]. MACHINE LEARNING, 1997, 29 (2-3) : 181 - 212