LOCALLY ASSOCIATED GRAPHICAL MODELS AND MIXED CONVEX EXPONENTIAL FAMILIES

被引:3
|
作者
Lauritzen, Steffen [1 ]
Zwiernik, Piotr [2 ]
机构
[1] Univ Copenhagen, Dept Math Sci, Copenhagen, Denmark
[2] Univ Toronto, Dept Stat Sci, Toronto, ON, Canada
来源
ANNALS OF STATISTICS | 2022年 / 50卷 / 05期
关键词
Association; convex optimization; dual likelihood; exponential families; Gaussian distribution; graphical lasso; Kullback-Leibler divergence; mixed parametrization; positive correlations; structure learning; MAXIMUM-LIKELIHOOD-ESTIMATION; MARGINAL HOMOGENEITY; TOTAL POSITIVITY; INFORMATION; VARIABLES; SELECTION; GEOMETRY; NETWORK;
D O I
10.1214/22-AOS2219
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The notion of multivariate total positivity has proved to be useful in finance and psychology but may be too restrictive in other applications. In this paper, we propose a concept of local association, where highly connected components in a graphical model are positively associated and study its properties. Our main motivation comes from gene expression data, where graphical models have become a popular exploratory tool. The models are instances of what we term mixed convex exponential families and we show that a mixed dual likelihood estimator has simple exact properties for such families as well as asymptotic properties similar to the maximum likelihood estimator. We further relax the positivity assumption by penalizing negative partial correlations in what we term the positive graphical lasso. Finally, we develop a GOLAZO algorithm based on block-coordinate descent that applies to a number of optimization procedures that arise in the context of graphical models, including the estimation problems described above. We derive results on existence of the optimum for such problems.
引用
收藏
页码:3009 / 3038
页数:30
相关论文
共 50 条
  • [1] Mixed Graphical Models via Exponential Families
    Yang, Eunho
    Baker, Yulia
    Ravikumar, Pradeep
    Allen, Genevera, I
    Liu, Zhandong
    ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 33, 2014, 33 : 1042 - 1050
  • [2] Graphical Models, Exponential Families, and Variational Inference
    Wainwright, Martin J.
    Jordan, Michael I.
    FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2008, 1 (1-2): : 1 - 305
  • [3] Stratified exponential families: Graphical models and model selection
    Geiger, D
    Heckerman, D
    King, H
    Meek, C
    ANNALS OF STATISTICS, 2001, 29 (02): : 505 - 529
  • [4] Inferring Block Structure of Graphical Models in Exponential Families
    Sun, Siqi
    Wang, Hai
    Xu, Jinbo
    ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 38, 2015, 38 : 939 - 947
  • [5] On graphical models and convex geometry
    Bar, Haim
    Wells, Martin T.
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2023, 187
  • [7] On Semiparametric Exponential Family Graphical Models
    Yang, Zhuoran
    Ning, Yang
    Liu, Han
    JOURNAL OF MACHINE LEARNING RESEARCH, 2018, 19
  • [9] Quasi-equicontinous exponential families of generalized function C-semigroups in locally convex spaces
    Kostic, Marko
    Pilipovic, Stevan
    Velinov, Daniel
    REVISTA DE LA REAL ACADEMIA DE CIENCIAS EXACTAS FISICAS Y NATURALES SERIE A-MATEMATICAS, 2019, 113 (02) : 453 - 469
  • [10] Quasi-equicontinous exponential families of generalized function C-semigroups in locally convex spaces
    Marko Kostić
    Stevan Pilipović
    Daniel Velinov
    Revista de la Real Academia de Ciencias Exactas, Físicas y Naturales. Serie A. Matemáticas, 2019, 113 : 453 - 469