LOCALLY ASSOCIATED GRAPHICAL MODELS AND MIXED CONVEX EXPONENTIAL FAMILIES

被引:3
|
作者
Lauritzen, Steffen [1 ]
Zwiernik, Piotr [2 ]
机构
[1] Univ Copenhagen, Dept Math Sci, Copenhagen, Denmark
[2] Univ Toronto, Dept Stat Sci, Toronto, ON, Canada
来源
ANNALS OF STATISTICS | 2022年 / 50卷 / 05期
关键词
Association; convex optimization; dual likelihood; exponential families; Gaussian distribution; graphical lasso; Kullback-Leibler divergence; mixed parametrization; positive correlations; structure learning; MAXIMUM-LIKELIHOOD-ESTIMATION; MARGINAL HOMOGENEITY; TOTAL POSITIVITY; INFORMATION; VARIABLES; SELECTION; GEOMETRY; NETWORK;
D O I
10.1214/22-AOS2219
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The notion of multivariate total positivity has proved to be useful in finance and psychology but may be too restrictive in other applications. In this paper, we propose a concept of local association, where highly connected components in a graphical model are positively associated and study its properties. Our main motivation comes from gene expression data, where graphical models have become a popular exploratory tool. The models are instances of what we term mixed convex exponential families and we show that a mixed dual likelihood estimator has simple exact properties for such families as well as asymptotic properties similar to the maximum likelihood estimator. We further relax the positivity assumption by penalizing negative partial correlations in what we term the positive graphical lasso. Finally, we develop a GOLAZO algorithm based on block-coordinate descent that applies to a number of optimization procedures that arise in the context of graphical models, including the estimation problems described above. We derive results on existence of the optimum for such problems.
引用
收藏
页码:3009 / 3038
页数:30
相关论文
共 50 条
  • [21] Selection and estimation for mixed graphical models
    Chen, Shizhe
    Witten, Daniela M.
    Shojaie, Ali
    BIOMETRIKA, 2015, 102 (01) : 47 - 64
  • [22] Learning the Structure of Mixed Graphical Models
    Lee, Jason D.
    Hastie, Trevor J.
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2015, 24 (01) : 230 - 253
  • [23] Graphical Models via Univariate Exponential Family Distributions
    Yang, Eunho
    Ravikumar, Pradeep
    Allen, Genevera I.
    Liu, Zhandong
    JOURNAL OF MACHINE LEARNING RESEARCH, 2015, 16 : 3813 - 3847
  • [24] Algorithms for Convex Hull Finding in Undirected Graphical Models
    Heng, Pei
    Sun, Yi
    APPLIED MATHEMATICS AND COMPUTATION, 2023, 445
  • [26] The absolutely representing families in certain classes of locally convex spaces
    Yu. F. Korobeinik
    Russian Mathematics, 2009, 53 (9) : 20 - 28
  • [27] The Absolutely Representing Families in Certain Classes of Locally Convex Spaces
    Korobeinik, Yu. F.
    RUSSIAN MATHEMATICS, 2009, 53 (09) : 20 - 28
  • [28] Imprecise probability models for inference in exponential families
    Quaeghebeur, Erik
    de Cooman, Gert
    ISIPTA 05-PROCEEDINGS OF THE FOURTH INTERNATIONAL SYMPOSIUM ON IMPRECISE PROBABILITIES AND THEIR APPLICATIONS, 2005, : 287 - 296
  • [29] EXPONENTIAL-FAMILIES AND VARIANCE COMPONENT MODELS
    CLASON, DL
    MURRAY, LW
    AMERICAN STATISTICIAN, 1992, 46 (01): : 29 - 31
  • [30] On the geometry of discrete exponential families with application to exponential random graph models
    Rinaldo, Alessandro
    Fienberg, Stephen E.
    Zhou, Yi
    ELECTRONIC JOURNAL OF STATISTICS, 2009, 3 : 446 - 484