Robustifying sum-product networks

被引:15
|
作者
Maua, Denis Deratani [1 ]
Conaty, Diarmaid [2 ]
Cozman, Fabio Gagliardi [3 ]
Poppenhaeger, Katja [4 ]
de Campos, Cassio Polpo [2 ,5 ]
机构
[1] Univ Sao Paulo, Inst Math & Stat, Sao Paulo, Brazil
[2] Queens Univ Belfast, Ctr Data Sci & Scalable Comp, Belfast, Antrim, North Ireland
[3] Univ Sao Paulo, Escola Politecn, Sao Paulo, Brazil
[4] Queens Univ Belfast, Astrophys Res Ctr, Belfast, Antrim, North Ireland
[5] Univ Utrecht, Dept Informat & Comp Sci, Utrecht, Netherlands
基金
巴西圣保罗研究基金会;
关键词
Sum-product networks; Tractable probabilistic models; Credal classification; Sensitivity analysis; Robust statistics; MODELS; INFERENCE;
D O I
10.1016/j.ijar.2018.07.003
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sum-product networks are a relatively new and increasingly popular family of probabilistic graphical models that allow for marginal inference with polynomial effort. They have been shown to achieve state-of-the-art performance in several tasks involving density estimation. Sum-product networks are typically learned from data; as such, inferences produced with them are prone to be unreliable and overconfident when data is scarce. In this work, we develop the credal sum-product networks, a generalization of sum-product networks that uses set-valued parameters. We present algorithms and complexity results for common inference tasks with this class of models. We also present an approach for assessing the reliability of classifications made with sum-product networks. We apply this approach on benchmark classification tasks as well as a new application in predicting the age of stars. Our experiments show that the use of credal sum-product networks allow us to distinguish between reliable and unreliable classifications with higher accuracy than standard approaches based on (precise) probability values. (C) 2018 Elsevier Inc. All rights reserved.
引用
收藏
页码:163 / 180
页数:18
相关论文
共 50 条
  • [1] Residual Sum-Product Networks
    Ventola, Fabrizio
    Stelzner, Karl
    Molina, Alejandro
    Kersting, Kristian
    [J]. INTERNATIONAL CONFERENCE ON PROBABILISTIC GRAPHICAL MODELS, VOL 138, 2020, 138 : 545 - 556
  • [2] Sum-Product Networks: A Survey
    Sanchez-Cauce, Raquel
    Paris, Iago
    Javier Diez, Francisco
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (07) : 3821 - 3839
  • [3] Sum-Product Autoencoding: Encoding and Decoding Representations Using Sum-Product Networks
    Vergari, Antonio
    Peharz, Robert
    Di Mauro, Nicola
    Molina, Alejandro
    Kersting, Kristian
    Esposito, Floriana
    [J]. THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 4163 - 4170
  • [4] On Learning the Structure of Sum-Product Networks
    Butz, Cory J.
    Oliveira, Jhonatan S.
    dos Santos, Andre E.
    [J]. 2017 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2017, : 2997 - 3004
  • [5] On Theoretical Properties of Sum-Product Networks
    Peharz, Robert
    Tschiatschek, Sebastian
    Pernkopf, Franz
    Domingos, Pedro
    [J]. ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 38, 2015, 38 : 744 - 752
  • [6] Dual Sum-Product Networks Autoencoding
    Wang, Shengsheng
    Zhang, Hang
    Liu, Jiayun
    Yu, Qiang-Yuan
    [J]. KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT (KSEM 2018), PT I, 2018, 11061 : 377 - 387
  • [7] Bayesian Learning of Sum-Product Networks
    Trapp, Martin
    Peharz, Robert
    Ge, Hong
    Pernkopf, Franz
    Ghahramani, Zoubin
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [8] On Converting Sum-Product Networks into Bayesian Networks
    dos Santos, Andre E.
    Butz, Cory J.
    Oliveira, Jhonatan S.
    [J]. ADVANCES IN ARTIFICIAL INTELLIGENCE, CANADIAN AI 2017, 2017, 10233 : 329 - 334
  • [9] Learning Relational Sum-Product Networks
    Nath, Aniruddh
    Domingos, Pedro
    [J]. PROCEEDINGS OF THE TWENTY-NINTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2015, : 2878 - 2886
  • [10] Visualizing and understanding Sum-Product Networks
    Vergari, Antonio
    Di Mauro, Nicola
    Esposito, Floriana
    [J]. MACHINE LEARNING, 2019, 108 (04) : 551 - 573