Restricted Boltzmann machine: Recent advances and mean-field theory*

被引:39
|
作者
Decelle, Aurelien [1 ,2 ,3 ]
Furtlehner, Cyril [2 ,3 ]
机构
[1] Univ Complutense, Dept Fis Teor 1, Madrid 28040, Spain
[2] Univ Paris Saclay, INRIA Saclay, TAU Team, F-91405 Orsay, France
[3] Univ Paris Saclay, LISN, F-91405 Orsay, France
关键词
restricted Boltzmann machine (RBM); machine learning; statistical physics; STATISTICAL-MECHANICS; NEURAL-NETWORKS; MODEL; STORAGE;
D O I
10.1088/1674-1056/abd160
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
This review deals with restricted Boltzmann machine (RBM) under the light of statistical physics. The RBM is a classical family of machine learning (ML) models which played a central role in the development of deep learning. Viewing it as a spin glass model and exhibiting various links with other models of statistical physics, we gather recent results dealing with mean-field theory in this context. First the functioning of the RBM can be analyzed via the phase diagrams obtained for various statistical ensembles of RBM, leading in particular to identify a compositional phase where a small number of features or modes are combined to form complex patterns. Then we discuss recent works either able to devise mean-field based learning algorithms; either able to reproduce generic aspects of the learning process from some ensemble dynamics equations or/and from linear stability arguments.
引用
收藏
页数:24
相关论文
共 50 条
  • [21] Boltzmann Machine learning and Mean Field Theory learning with momentum terms
    Hagiwara, Masafumi
    1600, Ablex Publ Corp, Norwood, NJ, United States (02): : 1 - 2
  • [22] Recent developments in mean-field theories
    Bender, Michael
    FRONTIERS IN NUCLEAR STRUCTURE, ASTROPHYSICS, AND REACTIONS: FINUSTAR 2, 2008, 1012 : 278 - 285
  • [23] Steady-state nonequilibrium dynamical mean-field theory and the quantum Boltzmann equation
    Freericks, J. K.
    Turkowski, V. M.
    PROGRESS IN NONEQUILIBRIUM GREEN'S FUNCTIONS III, 2006, 35 : 39 - +
  • [24] 2-BODY COLLISIONS AND MEAN-FIELD THEORY - THE BRUECKNER-BOLTZMANN EQUATION
    BOTERMANS, W
    MALFLIET, R
    PHYSICS LETTERS B, 1986, 171 (01) : 22 - 27
  • [25] A Boltzmann approach to mean-field sparse feedback control
    Albi, Giacomo
    Fornasier, Massimo
    Kalise, Dante
    IFAC PAPERSONLINE, 2017, 50 (01): : 2898 - 2903
  • [26] Restricted Open-Shell Cluster Mean-Field theory for Strongly Correlated Systems
    Bachhar, Arnab
    Mayhall, Nicholas J.
    JOURNAL OF PHYSICAL CHEMISTRY A, 2024, 128 (41): : 9015 - 9027
  • [27] Mean-field kinetic nucleation theory
    Kalikmanov, VI
    JOURNAL OF CHEMICAL PHYSICS, 2006, 124 (12):
  • [28] Generalized thermostatistics and mean-field theory
    Naudts, J
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2004, 332 : 279 - 300
  • [29] MEAN-FIELD THEORY OF FERROMAGNETIC SUPERCONDUCTORS
    JARIC, MV
    BELIC, M
    PHYSICAL REVIEW LETTERS, 1979, 42 (15) : 1015 - 1019
  • [30] RELATIVISTIC MEAN-FIELD THEORY AND HYPERNUCLEI
    MARES, J
    JENNINGS, BK
    NUCLEAR PHYSICS A, 1995, 585 (1-2) : C347 - C348