Entropy Message Passing

被引：4
|
作者：
Ilic, Velimir M. [1 ]
Stankovic, Miomir S. [2 ]
Todorovic, Branimir T. [1 ]
机构：
[1] Univ Nis, Dept Informat, Fac Sci & Math, Nish, Serbia
[2] Univ Nis, Fac Occupat Safety, Nish, Serbia
来源：
IEEE TRANSACTIONS ON INFORMATION THEORY | 2011年 / 57卷 / 01期
关键词：
Commutative semiring; factor graphs; entropy; expectation maximization; gradient methods; graphical models; sum-product message passing; PARAMETER-ESTIMATION; PROPAGATION; MODELS;
D O I：
10.1109/TIT.2010.2090235
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
The paper proposes a new message passing algorithm for cycle-free factor graphs. The proposed "entropy message passing" (EMP) algorithm may be viewed as sum-product message passing over the entropy semiring, which has previously appeared in automata theory. The primary use of EMP is to compute the entropy of a model. However, EMP can also be used to compute expressions that appear in expectation maximization and in gradient-descent algorithms.
引用
收藏
页码：375 / 380
页数：6
相关论文
共 50 条
  • [21] MESSAGE PASSING IN A TRANSPUTER SYSTEM
    KNOWLES, A
    KANTCHEV, T
    [J]. MICROPROCESSORS AND MICROSYSTEMS, 1989, 13 (02) : 113 - 123
  • [22] Proving Copyless Message Passing
    Villard, Jules
    Lozes, Etienne
    Calcagno, Cristiano
    [J]. PROGRAMMING LANGUAGES AND SYSTEMS, PROCEEDINGS, 2009, 5904 : 194 - +
  • [23] On Convergence of Approximate Message Passing
    Caltagirone, Francesco
    Zdeborova, Lenka
    Krzakala, Florent
    [J]. 2014 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2014, : 1812 - 1816
  • [24] Particle methods as message passing
    Dauwels, Justin
    Korl, Sascha
    Loeliger, Hans-Andrea
    [J]. 2006 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, VOLS 1-6, PROCEEDINGS, 2006, : 2052 - +
  • [25] Vector Approximate Message Passing
    Rangan, Sundeep
    Schniter, Philip
    Fletcher, Alyson K.
    [J]. 2017 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2017, : 1588 - 1592
  • [26] TYPING COPYLESS MESSAGE PASSING
    Bono, Viviana
    Padovani, Luca
    [J]. LOGICAL METHODS IN COMPUTER SCIENCE, 2012, 8 (01)
  • [27] Hybrid Approximate Message Passing
    Rangan, Sundeep
    Fletcher, Alyson K.
    Goyal, Vivek K.
    Byrne, Evan
    Schniter, Philip
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2017, 65 (17) : 4577 - 4592
  • [28] Typing Copyless Message Passing
    Bono, Viviana
    Messa, Chiara
    Padovani, Luca
    [J]. PROGRAMMING LANGUAGES AND SYSTEMS, 2011, 6602 : 57 - 76
  • [29] Steepest descent as message passing
    Dauwels, J
    Korl, S
    Loeliger, HA
    [J]. PROCEEDINGS OF THE IEEE ITSOC INFORMATION THEORY WORKSHOP 2005 ON CODING AND COMPLEXITY, 2005, : 42 - 46
  • [30] Message passing for vertex covers
    Weigt, Martin
    Zhou, Haijun
    [J]. PHYSICAL REVIEW E, 2006, 74 (04):
12345