Faithfulness and learning hypergraphs from discrete distributions

被引:2
|
作者
Klimova, Anna [1 ]
Uhler, Caroline [1 ]
Rudas, Tamas [2 ]
机构
[1] IST Austria, A-3400 Klosterneuburg, Austria
[2] Eotvos Lorand Univ, H-1117 Budapest, Hungary
关键词
Contingency tables; Directed acyclic graphs; Hierarchical log-linear models; Hypergraphs; (Strong-)faithfulness; MODELS;
D O I
10.1016/j.csda.2015.01.017
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The concepts of faithfulness and strong-faithfulness are important for statistical learning of graphical models. Graphs are not sufficient for describing the association structure of a discrete distribution. Hypergraphs representing hierarchical log-linear models are considered instead, and the concept of parametric (strong-)faithfulness with respect to a hypergraph is introduced. The strength of association in a discrete distribution can be quantified with various measures, leading to different concepts of strong-faithfulness. It is proven that strong-faithfulness defined in terms of interaction parameters ensures the existence of uniformly consistent parameter estimators and enables building uniformly consistent procedures for a hypergraph search. Lower and upper bounds for the proportions of distributions that do not satisfy strong-faithfulness are computed for different parameterizations and measures of association. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:57 / 72
页数:16
相关论文
共 50 条
  • [11] Learning mixtures of product distributions over discrete domains
    Feldman, J
    O'Donnell, R
    Servedio, RA
    46TH ANNUAL IEEE SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE, PROCEEDINGS, 2005, : 501 - 510
  • [12] Learning mixtures of structured distributions over discrete domains
    Chan, Siu-On
    Diakonikolas, Ilias
    Servedio, Rocco A.
    Sun, Xiaorui
    PROCEEDINGS OF THE TWENTY-FOURTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS (SODA 2013), 2013, : 1380 - 1394
  • [13] PAC learning of probability distributions over a discrete domain
    Magnoni, L
    Mirolli, M
    Montagna, F
    Simi, G
    THEORETICAL COMPUTER SCIENCE, 2003, 299 (1-3) : 37 - 63
  • [14] On concentration of discrete distributions with applications to supervised learning of classifiers
    Ekdahl, Magnus
    Koski, Timo
    MACHINE LEARNING AND DATA MINING IN PATTERN RECOGNITION, PROCEEDINGS, 2007, 4571 : 2 - +
  • [15] Learning Description Logic Axioms from Discrete Probability Distributions over Description Graphs
    Kriegel, Francesco
    LOGICS IN ARTIFICIAL INTELLIGENCE, JELIA 2019, 2019, 11468 : 399 - 417
  • [16] kth records from discrete distributions
    Dembinska, A
    López-Blázquez, F
    STATISTICS & PROBABILITY LETTERS, 2005, 71 (03) : 203 - 214
  • [17] Succinct Sampling from Discrete Distributions
    Bringmann, Karl
    Larsen, Kasper Green
    STOC'13: PROCEEDINGS OF THE 2013 ACM SYMPOSIUM ON THEORY OF COMPUTING, 2013, : 775 - 782
  • [18] LEARNING SPARSE HYPERGRAPHS FROM DYADIC RELATIONAL DATA
    Coutino, Mario
    Chepuri, Sundeep Prabhakar
    Leus, Geert
    2019 IEEE 8TH INTERNATIONAL WORKSHOP ON COMPUTATIONAL ADVANCES IN MULTI-SENSOR ADAPTIVE PROCESSING (CAMSAP 2019), 2019, : 216 - 220
  • [19] Learning on Hypergraphs With Sparsity
    Nguyen, Canh Hao
    Mamitsuka, Hiroshi
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (08) : 2710 - 2722
  • [20] Communication-Efficient Distributed Learning of Discrete Probability Distributions
    Diakonikolas, Ilias
    Grigorescu, Elena
    Li, Jerry
    Natarajan, Abhiram
    Onak, Krzysztof
    Schmidt, Ludwig
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30