Maximum Persistency via Iterative Relaxed Inference in Graphical Models

被引:4
|
作者
Shekhovtsov, Alexander [1 ]
Swoboda, Paul [2 ]
Savchynskyy, Bogdan [3 ]
机构
[1] Graz Univ Technol, Inst Comp Graph & Vis ICG, Inffeldgasse 16, A-8010 Graz, Austria
[2] IST Austria, Discrete Optimizat Grp, Campus 1, A-3400 Klosterneuburg, Austria
[3] Tech Univ Dresden, Comp Vis Lab, Fac Comp Sci, Inst Artificial Intelligence, D-01062 Dresden, Germany
基金
欧洲研究理事会; 奥地利科学基金会;
关键词
Persistency; partial optimality; LP relaxation; discrete optimization; WCSP; graphical models; energy minimization; ENERGY MINIMIZATION;
D O I
10.1109/TPAMI.2017.2730884
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We consider the NP-hard problem of MAP-inference for undirected discrete graphical models. We propose a polynomial time and practically efficient algorithm for finding a part of its optimal solution. Specifically, our algorithm marks some labels of the considered graphical model either as (i) optimal, meaning that they belong to all optimal solutions of the inference problem; (ii) non-optimal if they provably do not belong to any solution. With access to an exact solver of a linear programming relaxation to the MAP-inference problem, our algorithm marks the maximal possible (in a specified sense) number of labels. We also present a version of the algorithm, which has access to a suboptimal dual solver only and still can ensure the (non-) optimality for the marked labels, although the overall number of the marked labels may decrease. We propose an efficient implementation, which runs in time comparable to a single run of a suboptimal dual solver. Our method is well-scalable and shows state-of-the-art results on computational benchmarks from machine learning and computer vision.
引用
收藏
页码:1668 / 1682
页数:15
相关论文
共 50 条
  • [41] Inference in Probabilistic Graphical Models by Graph Neural Networks
    Yoon, KiJung
    Liao, Renjie
    Xiong, Yuwen
    Zhang, Lisa
    Fetaya, Ethan
    Urtasun, Raquel
    Zemel, Richard
    Pitkow, Xaq
    CONFERENCE RECORD OF THE 2019 FIFTY-THIRD ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, 2019, : 868 - 875
  • [42] Improving probabilistic inference in graphical models with determinism and cycles
    Mohamed-Hamza Ibrahim
    Christopher Pal
    Gilles Pesant
    Machine Learning, 2017, 106 : 1 - 54
  • [43] Fast Bayesian inference in large Gaussian graphical models
    Leday, Gwenael G. R.
    Richardson, Sylvia
    BIOMETRICS, 2019, 75 (04) : 1288 - 1298
  • [44] Feedback Message Passing for Inference in Gaussian Graphical Models
    Liu, Ying
    Chandrasekaran, Venkat
    Anandkumar, Animashree
    Willsky, Alan S.
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2012, 60 (08) : 4135 - 4150
  • [45] Comparison of two inference approaches in Gaussian graphical models
    Purutcuoglu, Vilda
    Ayyildiz, Ezgi
    Wit, Ernst
    TURKISH JOURNAL OF BIOCHEMISTRY-TURK BIYOKIMYA DERGISI, 2017, 42 (02): : 203 - 211
  • [46] Graphical Models for Distributed Inference in Wireless Sensor Networks
    Trivedi, Neeta
    Balakrishnan, N.
    2009 3RD INTERNATIONAL CONFERENCE ON SENSOR TECHNOLOGIES AND APPLICATIONS (SENSORCOMM 2009), 2009, : 596 - +
  • [47] Feedback Message Passing for Inference in Gaussian Graphical Models
    Liu, Ying
    Chandrasekaran, Venkat
    Anandkumar, Animashree
    Willsky, Alan S.
    2010 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, 2010, : 1683 - 1687
  • [48] Neural Variational Inference and Learning in Undirected Graphical Models
    Kuleshov, Volodymyr
    Ermon, Stefano
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 30 (NIPS 2017), 2017, 30
  • [49] Linear response algorithms for approximate inference in graphical models
    Welling, M
    Teh, YW
    NEURAL COMPUTATION, 2004, 16 (01) : 197 - 221
  • [50] All-Optical Graphical Models for Probabilistic Inference
    Blanche, Pierre-Alexandre
    Glick, Madeleine
    Wissinger, John
    Kieu, Khanh
    Babaeian, Masoud
    Rastegarfar, Houman
    Demir, Veysi
    Akbulut, Mehmetcan
    Keiffer, Patrick
    Norwood, Robert A.
    Peyghambarian, Nasser
    Neifeld, Mark
    2016 IEEE PHOTONICS SOCIETY SUMMER TOPICAL MEETING SERIES (SUM), 2016, : 199 - 200