Self-Validated Labeling of Markov Random Fields for Image Segmentation

被引:74
|
作者
Feng, Wei [1 ]
Jia, Jiaya [2 ]
Liu, Zhi-Qiang
机构
[1] City Univ Hong Kong, Sch Creat Media, Media Comp Grp, Kowloon, Hong Kong, Peoples R China
[2] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Shatin, Hong Kong, Peoples R China
关键词
Self-validated labeling; Markov random fields (MRFs); graduated graph cuts; image segmentation; split-and-merge; ENERGY MINIMIZATION; GRAPH CUTS;
D O I
10.1109/TPAMI.2010.24
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper addresses the problem of self-validated labeling of Markov random fields (MRFs), namely to optimize an MRF with unknown number of labels. We present graduated graph cuts (GGC), a new technique that extends the binary s-t graph cut for self-validated labeling. Specifically, we use the split-and-merge strategy to decompose the complex problem to a series of tractable subproblems. In terms of Gibbs energy minimization, a suboptimal labeling is gradually obtained based upon a set of cluster-level operations. By using different optimization structures, we propose three practical algorithms: tree-structured graph cuts (TSGC), net-structured graph cuts (NSGC), and hierarchical graph cuts (HGC). In contrast to previous methods, the proposed algorithms can automatically determine the number of labels, properly balance the labeling accuracy, spatial coherence, and the labeling cost (i.e., the number of labels), and are computationally efficient, independent to initialization, and able to converge to good local minima of the objective energy function. We apply the proposed algorithms to natural image segmentation. Experimental results show that our algorithms produce generally feasible segmentations for benchmark data sets, and outperform alternative methods in terms of robustness to noise, speed, and preservation of soft boundaries.
引用
收藏
页码:1871 / 1887
页数:17
相关论文
共 50 条
  • [1] Markov Random Fields in Image Segmentation
    Kato, Zoltan
    Zerubia, Josiane
    FOUNDATIONS AND TRENDS IN SIGNAL PROCESSING, 2011, 5 (1-2): : 1 - 155
  • [2] Self-validated Story Segmentation of Chinese Broadcast News
    Feng, Wei
    Xie, Lei
    Zhang, Jin
    Zhang, Yujun
    Zhang, Yanning
    ADVANCES IN BRAIN INSPIRED COGNITIVE SYSTEMS, BICS 2018, 2018, 10989 : 568 - 578
  • [3] Double Markov random fields and Bayesian image segmentation
    Melas, DE
    Wilson, SP
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2002, 50 (02) : 357 - 365
  • [4] Extended Markov random fields for predictive image segmentation
    Stolkin, R.
    Hodgetts, M.
    Greig, A.
    Gilby, J.
    PROCEEDINGS OF THE SIXTH INTERNATIONAL CONFERENCE ON ADVANCES IN PATTERN RECOGNITION, 2007, : 208 - +
  • [5] Pairwise and Hidden Markov Random Fields in Image Segmentation
    Courbot, Jean-Baptiste
    Mazet, Vincent
    28TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2020), 2021, : 2458 - 2462
  • [6] Unsupervised image segmentation using Markov Random Fields
    Sengur, Abdulkadir
    Turkoglu, Ibrahim
    Ince, M. Cevdet
    ARTIFICIAL INTELLIGENCE AND NEURAL NETWORKS, 2006, 3949 : 158 - 167
  • [7] Pixon-based image segmentation with Markov random fields
    Yang, FG
    Jiang, TZ
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2003, 12 (12) : 1552 - 1559
  • [8] Adaptive color image segmentation using Markov random fields
    Wesolkowski, S
    Fieguth, P
    2002 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL III, PROCEEDINGS, 2002, : 769 - 772
  • [9] Image segmentation by tree-structured Markov random fields
    Poggi, G
    Ragozini, ARP
    IEEE SIGNAL PROCESSING LETTERS, 1999, 6 (07) : 155 - 157
  • [10] Contextual image segmentation based on AdaBoost and Markov random fields
    Nishii, R
    IGARSS 2003: IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, VOLS I - VII, PROCEEDINGS: LEARNING FROM EARTH'S SHAPES AND SIZES, 2003, : 3507 - 3509