Marginal Likelihood Based Model Comparison in Fuzzy Bayesian Learning

被引:1
|
作者
Pan, Indranil [1 ,2 ]
Bester, Dirk [1 ,3 ,4 ]
机构
[1] Sciemus Ltd, London EC3V 3PD, England
[2] Imperial Coll London, London SW7 2AZ, England
[3] Univ Oxford, Oxford OX1 2JD, England
[4] Barclays Bank, London, England
关键词
Fuzzy logic; nested sampling; machine learning; Bayesian evidence; model selection; SYSTEM;
D O I
10.1109/TETCI.2018.2868253
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In a recent paper [1], we introduced the fuzzy Bayesian learning paradigm where expert opinions can be encoded in the form of fuzzy rule bases and the hyper-parameters of the fuzzy sets can be learned from data using a Bayesian approach. The present paper extends this work for selecting the most appropriate rule base among a set of competing alternatives, which best explains the data, by calculating the model evidence or marginal likelihood. We explain why this is an attractive alternative over simply minimizing a mean squared error metric of prediction and show the validity of the proposition using synthetic examples and a real world case study in the financial services sector.
引用
收藏
页码:794 / 799
页数:6
相关论文
共 50 条
  • [1] Bayesian Model Selection, the Marginal Likelihood, and Generalization
    Lotfi, Sanae
    Izmailov, Pavel
    Benton, Gregory
    Goldblum, Micah
    Wilson, Andrew Gordon
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [2] A Variant of AIC Based on the Bayesian Marginal Likelihood
    Yuki Kawakubo
    Tatsuya Kubokawa
    Muni S. Srivastava
    [J]. Sankhya B, 2018, 80 (1) : 60 - 84
  • [3] A Variant of AIC Based on the Bayesian Marginal Likelihood
    Kawakubo, Yuki
    Kubokawa, Tatsuya
    Srivastava, Muni S.
    [J]. SANKHYA-SERIES B-APPLIED AND INTERDISCIPLINARY STATISTICS, 2018, 80 : 60 - 84
  • [4] Consensus Based Distributed Sparse Bayesian Learning by Fast Marginal Likelihood Maximization
    Manss, Christoph
    Shutin, Dmitriy
    Leus, Geert
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 2119 - 2123
  • [5] Bayesian Allocation Model: Marginal Likelihood-Based Model Selection for Count Tensors
    Yldrm, Sinan
    Kurutmaz, M. Burak
    Barsbey, Melih
    Simsekli, Umut
    Cemgil, A. Taylan
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2021, 15 (03) : 560 - 573
  • [6] A fuzzy negotiation model based on Bayesian learning
    Wu Yuying
    Lu Jinxuan
    Yan Feng
    [J]. PICMET '07: PORTLAND INTERNATIONAL CENTER FOR MANAGEMENT OF ENGINEERING AND TECHNOLOGY, VOLS 1-6, PROCEEDINGS: MANAGEMENT OF CONVERGING TECHNOLOGIES, 2007, : 1239 - 1247
  • [7] Improving Marginal Likelihood Estimation for Bayesian Phylogenetic Model Selection
    Xie, Wangang
    Lewis, Paul O.
    Fan, Yu
    Kuo, Lynn
    Chen, Ming-Hui
    [J]. SYSTEMATIC BIOLOGY, 2011, 60 (02) : 150 - 160
  • [8] Group Sparse Bayesian Learning Via Exact and Fast Marginal Likelihood Maximization
    Ma, Zeqiang
    Dai, Wei
    Liu, Yimin
    Wang, Xiqin
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2017, 65 (10) : 2741 - 2753
  • [9] GROUP SPARSE BAYESIAN LEARNING VIA EXACT AND FAST MARGINAL LIKELIHOOD MAXIMIZATION
    Ma, Zeqiang
    Dai, Wei
    Liu, Yimin
    Wang, Xiqin
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 4508 - 4512
  • [10] Scalable Marginal Likelihood Estimation for Model Selection in Deep Learning
    Immer, Alexander
    Bauer, Matthias
    Fortuin, Vincent
    Ratsch, Gunnar
    Khan, Mohammad Emtiyaz
    [J]. INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139