A Variant of AIC Based on the Bayesian Marginal Likelihood

被引:0
|
作者
Yuki Kawakubo
Tatsuya Kubokawa
Muni S. Srivastava
机构
[1] Chiba University,Graduate School of Social Sciences
[2] University of Tokyo,Faculty of Economics
[3] University of Toronto,Department of Statistics
关键词
AIC; BIC; Consistency; Kullback–Leibler divergence; Linear regression model; Residual information criterion; Variable selection; Primary 62J05; Secondary 62F12;
D O I
暂无
中图分类号
学科分类号
摘要
We propose information criteria that measure the prediction risk of a predictive density based on the Bayesian marginal likelihood from a frequentist point of view. We derive criteria for selecting variables in linear regression models, assuming a prior distribution of the regression coefficients. Then, we discuss the relationship between the proposed criteria and related criteria. There are three advantages of our method. First, this is a compromise between the frequentist and Bayesian standpoints because it evaluates the frequentist’s risk of the Bayesian model. Thus, it is less influenced by a prior misspecification. Second, the criteria exhibits consistency when selecting the true model. Third, when a uniform prior is assumed for the regression coefficients, the resulting criterion is equivalent to the residual information criterion (RIC) of Shi and Tsai (J. R. Stat. Soc. Ser. B64, 237–252 2002).
引用
收藏
页码:60 / 84
页数:24
相关论文
共 50 条
  • [41] Efficient stochastic optimisation by unadjusted Langevin Monte CarloApplication to maximum marginal likelihood and empirical Bayesian estimation
    Valentin De Bortoli
    Alain Durmus
    Marcelo Pereyra
    Ana F. Vidal
    [J]. Statistics and Computing, 2021, 31
  • [42] Bayesian empirical likelihood
    Lazar, NA
    [J]. BIOMETRIKA, 2003, 90 (02) : 319 - 326
  • [43] Bayesian Synthetic Likelihood
    Price, L. F.
    Drovandi, C. C.
    Lee, A.
    Nott, D. J.
    [J]. JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2018, 27 (01) : 1 - 11
  • [44] Simulation-based marginal likelihood for cluster strong lensing cosmology
    Killedar, M.
    Borgani, S.
    Fabjan, D.
    Dolag, K.
    Granato, G.
    Meneghetti, M.
    Planelles, S.
    Ragone-Figueroa, C.
    [J]. MONTHLY NOTICES OF THE ROYAL ASTRONOMICAL SOCIETY, 2018, 473 (02) : 1736 - 1750
  • [45] On an Empirical Likelihood Based Solution to the Approximate Bayesian Computation Problem
    Chaudhuri, Sanjay
    Ghosh, Subhroshekhar
    Pham, Kim Cuc
    [J]. Statistical Analysis and Data Mining, 2024, 17 (05)
  • [46] Maximum-likelihood ambiguity resolution based on Bayesian principle
    Zhu, J
    Ding, X
    Chen, Y
    [J]. JOURNAL OF GEODESY, 2001, 75 (04) : 175 - 187
  • [47] Maximum-likelihood ambiguity resolution based on Bayesian principle
    J. Zhu
    X. Ding
    Y. Chen
    [J]. Journal of Geodesy, 2001, 75 : 175 - 187
  • [48] Efficient stochastic optimisation by unadjusted Langevin Monte Carlo Application to maximum marginal likelihood and empirical Bayesian estimation
    De Bortoli, Valentin
    Durmus, Alain
    Pereyra, Marcelo
    Vidal, Ana F.
    [J]. STATISTICS AND COMPUTING, 2021, 31 (03)
  • [49] Marginal likelihood from the Gibbs output
    Chib, S
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1995, 90 (432) : 1313 - 1321
  • [50] The marginal likelihood of dynamic mixture models
    Fiorentini, G.
    Planas, C.
    Rossi, A.
    [J]. COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2012, 56 (09) : 2650 - 2662