On Convergence Conditions of Gaussian Belief Propagation

被引:55
|
作者
Su, Qinliang [1 ]
Wu, Yik-Chung [1 ]
机构
[1] Univ Hong Kong, Dept Elect & Elect Engn, Hong Kong, Hong Kong, Peoples R China
关键词
Convergence; factor graph; Gaussian belief propagation; graphical model; loopy belief propagation; message passing; sum-product algorithm; WIRELESS SENSOR NETWORKS; GRAPHICAL MODELS; SOLVER;
D O I
10.1109/TSP.2015.2389755
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In order to compute the marginal probability density function (PDF) with Gaussian belief propagation (BP), it is important to know whether it will converge in advance. By describing the message-passing process of Gaussian BP on the pairwise factor graph as a set of updating functions, the necessary and sufficient convergence condition of beliefs in synchronous Gaussian BP is first derived under a newly proposed initialization set. The proposed initialization set is proved to be largest among all currently known sets. Then, the necessary and sufficient convergence condition of beliefs in damped Gaussian BP is developed, with the allowable range of damping factor explicitly established. The results theoretically confirm the extensively reported conjecture that damping is helpful to improve the convergence of Gaussian BP. Under totally asynchronous scheduling, a sufficient convergence condition of beliefs is also derived for the same proposed initialization set. Relationships between the proposed convergence conditions and existing ones are established analytically. At last, numerical examples are presented to corroborate the established theories.
引用
收藏
页码:1144 / 1155
页数:12
相关论文
共 50 条
  • [41] CONVERGENCE OF A GENERALIZED BELIEF PROPAGATION ALGORITHM FOR BIOLOGICAL NETWORKS†
    Choo, Sang-Mok
    Kim, Young-Hee
    [J]. JOURNAL OF APPLIED MATHEMATICS & INFORMATICS, 2022, 40 (3-4): : 515 - 530
  • [42] Convergence and correctness of belief propagation for the Chinese postman problem
    Dai, Guowei
    Li, Fengwei
    Sun, Yuefang
    Xu, Dachuan
    Zhang, Xiaoyan
    [J]. JOURNAL OF GLOBAL OPTIMIZATION, 2019, 75 (03) : 813 - 831
  • [43] Walk-sums and belief propagation in Gaussian graphical models
    Malioutov, Dmitry M.
    Johnson, Jason K.
    Willsky, Alan S.
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2006, 7 : 2031 - 2064
  • [44] Correctness of belief propagation in Gaussian graphical models of arbitrary topology
    Weiss, Y
    Freeman, WT
    [J]. NEURAL COMPUTATION, 2001, 13 (10) : 2173 - 2200
  • [45] Parallel finite element technique using Gaussian belief propagation
    El-Kurdi, Yousef
    Dehnavi, Maryam Mehri
    Gross, Warren J.
    Giannacopoulos, Dennis
    [J]. COMPUTER PHYSICS COMMUNICATIONS, 2015, 193 : 38 - 48
  • [46] Cooperative hybrid localization using Gaussian processes and belief propagation
    Van de Velde, Samuel
    Arora, Gundeep
    Vallozzi, Luigi
    Rogier, Hendrik
    Steendam, Heidi
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATION WORKSHOP (ICCW), 2015, : 785 - 790
  • [47] Complex Gaussian Belief Propagation Algorithms for Distributed Iterative Receiver
    Yue, Ziqi
    Guo, Qing
    Xiang, Wei
    [J]. 2014 IEEE 25TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR, AND MOBILE RADIO COMMUNICATION (PIMRC), 2014, : 1908 - 1912
  • [48] GAUSSIAN BELIEF PROPAGATION SOLVERS FOR NONSYMMETRIC SYSTEMS OF LINEAR EQUATIONS*
    Fanaskov, Vladimir
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2022, 44 (01): : A77 - A102
  • [49] Belief Propagation with Gaussian Approximation for Joint Channel Estimation and Decoding
    Liu, Yang
    Brunel, Loiec
    Boutros, Joseph J.
    [J]. 2008 IEEE 19TH INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, 2008, : 2312 - +
  • [50] Correctness of belief propagation in Gaussian graphical models of arbitrary topology
    Weiss, Y
    Freeman, WT
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 12, 2000, 12 : 673 - 679