Mean field theory for sigmoid belief networks

被引:202
|
作者
Saul, LK
Jaakkola, T
Jordan, MI
机构
[1] Ctr. for Biol./Compl. Learning, Massachusetts Inst. of Technology, Cambridge, MA 02139, 79 Amherst Street
来源
JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH | 1996年 / 4卷
关键词
D O I
10.1613/jair.251
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We develop a mean field theory for sigmoid belief networks based on ideas from statistical mechanics. Our mean field theory provides a tractable approximation to the true probability distribution in these networks; it also yields a lower bound on the likelihood of evidence. We demonstrate the utility of this framework on a benchmark problem in statistical pattern recognition-the classification of handwritten digits.
引用
收藏
页码:61 / 76
页数:16
相关论文
共 50 条
  • [41] Mean-field theory of graph neural networks in graph partitioning
    Kawamoto, Tatsuro
    Tsubaki, Masashi
    Obuchi, Tomoyuki
    JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT, 2019, 2019 (12):
  • [42] Mean-field theory for scale-free random networks
    Barabási, AL
    Albert, R
    Jeong, H
    PHYSICA A, 1999, 272 (1-2): : 173 - 187
  • [43] Belief and Opinion Evolution in Social Networks Based on a Multi-Population Mean Field Game Approach
    Banez, Reginald A.
    Ciao, Hao
    Li, Lixin
    Yang, Chungang
    Han, Zhu
    Poor, H. Vincent
    ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [44] An Improved Heterogeneous Mean-Field Theory for the Ising Model on Complex Networks
    黄凤
    陈含爽
    CommunicationsinTheoreticalPhysics, 2019, 71 (12) : 1475 - 1479
  • [45] A note on mean-field theory for scale-free random networks
    Gu, Jin-li
    Bai, Yan-qin
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES B-APPLICATIONS & ALGORITHMS, 2006, 13 (3-4): : 523 - 531
  • [46] An Improved Heterogeneous Mean-Field Theory for the Ising Model on Complex Networks
    Huang, Feng
    Chen, Han-Shuang
    COMMUNICATIONS IN THEORETICAL PHYSICS, 2019, 71 (12) : 1475 - 1479
  • [47] Generalized mean-field theory for Ising spins in small world networks
    Meilikhov, EZ
    Farzetdinova, RM
    PHYSICAL REVIEW E, 2005, 71 (04):
  • [48] Dynamical Mean-Field Theory of Complex Systems on Sparse Directed Networks
    Metz, Fernando L.
    PHYSICAL REVIEW LETTERS, 2025, 134 (03)
  • [49] OPTIMAL ATTACK AND DEFENCE OF LARGE SCALE NETWORKS USING MEAN FIELD THEORY
    del Val, Jorge
    Zazo, Santiago
    Valcarcel Macua, Sergio
    Zazo, Javier
    Parras, Juan
    2016 24TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2016, : 973 - 977
  • [50] A MEAN-FIELD APPROACH OF THE THEORY OF TOPOLOGICAL CONSTRAINTS IN POLYMER MELTS AND NETWORKS
    HEINRICH, G
    STRAUBE, E
    MAKROMOLEKULARE CHEMIE-MACROMOLECULAR SYMPOSIA, 1989, 30 : 223 - 235