On Convergence Conditions of Gaussian Belief Propagation

被引:55
|
作者
Su, Qinliang [1 ]
Wu, Yik-Chung [1 ]
机构
[1] Univ Hong Kong, Dept Elect & Elect Engn, Hong Kong, Hong Kong, Peoples R China
关键词
Convergence; factor graph; Gaussian belief propagation; graphical model; loopy belief propagation; message passing; sum-product algorithm; WIRELESS SENSOR NETWORKS; GRAPHICAL MODELS; SOLVER;
D O I
10.1109/TSP.2015.2389755
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In order to compute the marginal probability density function (PDF) with Gaussian belief propagation (BP), it is important to know whether it will converge in advance. By describing the message-passing process of Gaussian BP on the pairwise factor graph as a set of updating functions, the necessary and sufficient convergence condition of beliefs in synchronous Gaussian BP is first derived under a newly proposed initialization set. The proposed initialization set is proved to be largest among all currently known sets. Then, the necessary and sufficient convergence condition of beliefs in damped Gaussian BP is developed, with the allowable range of damping factor explicitly established. The results theoretically confirm the extensively reported conjecture that damping is helpful to improve the convergence of Gaussian BP. Under totally asynchronous scheduling, a sufficient convergence condition of beliefs is also derived for the same proposed initialization set. Relationships between the proposed convergence conditions and existing ones are established analytically. At last, numerical examples are presented to corroborate the established theories.
引用
收藏
页码:1144 / 1155
页数:12
相关论文
共 50 条
  • [1] Fixing Convergence of Gaussian Belief Propagation
    Johnson, Jason K.
    Bickson, Danny
    Dolev, Danny
    [J]. 2009 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, VOLS 1- 4, 2009, : 1674 - +
  • [2] Convergence Analysis of the Variance in Gaussian Belief Propagation
    Su, Qinliang
    Wu, Yik-Chung
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2014, 62 (19) : 5119 - 5131
  • [3] Distributed Convergence Verification for Gaussian Belief Propagation
    Du, Jian
    Kar, Soummya
    Moura, Jose M. F.
    [J]. 2017 FIFTY-FIRST ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS, AND COMPUTERS, 2017, : 1439 - 1443
  • [4] DISTRIBUTED VERIFICATION OF BELIEF PRECISIONS CONVERGENCE IN GAUSSIAN BELIEF PROPAGATION
    Li, Bin
    Wu, Nan
    Wu, Yik-Chung
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 9115 - 9119
  • [5] CONVERGENCE ANALYSIS OF THE INFORMATION MATRIX IN GAUSSIAN BELIEF PROPAGATION
    Du, Jian
    Ma, Shaodan
    Wu, Yik-Chung
    Kar, Soummya
    Moura, Jose M. F.
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 4074 - 4078
  • [6] On the convergence of Gaussian belief propagation with nodes of arbitrary size
    Kamper, Francois
    Steel, Sarel J.
    du Preez, Johan A.
    [J]. Journal of Machine Learning Research, 2019, 20
  • [7] On the Convergence of Gaussian Belief Propagation with Nodes of Arbitrary Size
    Kamper, Francois
    Steel, Sarel J.
    du Preez, Johan A.
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2019, 20
  • [8] Fixed Points of Gaussian Belief Propagation and Relation to Convergence
    Li, Bin
    Su, Qinliang
    Wu, Yik-Chung
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2019, 67 (23) : 6025 - 6038
  • [9] Convergence rate analysis of Gaussian belief propagation for Markov networks
    Zhang, Zhaorong
    Fu, Minyue
    [J]. IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2020, 7 (03) : 668 - 673
  • [10] Convergence Rate Analysis of Gaussian Belief Propagation for Markov Networks
    Zhaorong Zhang
    Minyue Fu
    [J]. IEEE/CAA Journal of Automatica Sinica, 2020, 7 (03) : 668 - 673