Appearance-consistent Video Object Segmentation Based on a Multinomial Event Model

被引:4
|
作者
Chen, Yadang [1 ]
Hao, Chuanyan [2 ]
Liu, Alex X. [3 ,4 ]
Wu, Enhua [5 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Sch Educ Sci & Technol, Nanjing 210023, Jiangsu, Peoples R China
[3] Michigan State Univ, Dept Comp Sci & Engn, E Lansing, MI 48824 USA
[4] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210044, Jiangsu, Peoples R China
[5] Univ Chinese Acad Sci, Inst Software, State Key Lab Comp Sci, Beijing 100864, Peoples R China
基金
美国国家科学基金会; 中国国家自然科学基金;
关键词
Multinomial event model; appearance consistency; Markov random field; TRACKING;
D O I
10.1145/3321507
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this study, we propose an effective and efficient algorithm for unconstrained video object segmentation, which is achieved in a Markov random field (MRF). In the MRF graph, each node is modeled as a superpixel and labeled as either foreground or background during the segmentation process. The unary potential is computed for each node by learning a transductive SVM classifier under supervision by a few labeled frames. The pairwise potential is used for the spatial-temporal smoothness. In addition, a high-order potential based on the multinomial event model is employed to enhance the appearance consistency throughout the frames. To minimize this intractable feature, we also introduce a more efficient technique that simply extends the original MRF structure. The proposed approach was evaluated in experiments with different measures and the results based on a benchmark demonstrated its effectiveness compared with other state-of-the-art algorithms.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Object based video segmentation using multiple cues
    Fu, XP
    Liang, DQ
    8TH WORLD MULTI-CONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL VI, PROCEEDINGS: IMAGE, ACOUSTIC, SIGNAL PROCESSING AND OPTICAL SYSTEMS, TECHNOLOGIES AND APPLICATIONS, 2004, : 222 - 226
  • [42] Rethinking RNN-Based Video Object Segmentation
    Azimi, Fatemeh
    Raue, Federico
    Hees, Joern
    Dengel, Andreas
    COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VISIGRAPP 2021, 2023, 1691 : 348 - 365
  • [43] Fast Video Object Segmentation Based on Siamese Networks
    Fu L.-H.
    Zhao Y.
    Sun X.-W.
    Lu Z.-S.
    Wang D.
    Yang H.-X.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2020, 48 (04): : 625 - 630
  • [44] An Improved Object-Based Video Segmentation Method
    Xu, Wendan
    Lai, Xinquan
    Xu, Donglai
    ADVANCES IN MANUFACTURING TECHNOLOGY, PTS 1-4, 2012, 220-223 : 2445 - 2449
  • [45] A ROBUST FRAMEWORK FOR REGION BASED VIDEO OBJECT SEGMENTATION
    Escudero-Vinolo, Marcos
    Bescos, Jesus
    2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 3461 - 3464
  • [46] Content-based object segmentation in video sequences
    Tsougarakis, C
    Panchanathan, S
    VISUAL COMMUNICATIONS AND IMAGE PROCESSING '99, PARTS 1-2, 1998, 3653 : 1269 - 1276
  • [47] Adaptive Threshold based Segmentation for Video Object Tracking
    Gambhir, Deepak
    Manchanda, Meenu
    SOUVENIR OF THE 2014 IEEE INTERNATIONAL ADVANCE COMPUTING CONFERENCE (IACC), 2014, : 1127 - 1132
  • [48] Efficient Video Object Segmentation Based on Gaussian Mixture Model and Markov Random Field
    Liu, Zhi
    Gu, Jiandong
    Shen, Liquan
    Zhang, Zhaoyang
    ICSP: 2008 9TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, VOLS 1-5, PROCEEDINGS, 2008, : 1006 - 1009
  • [49] An appearance-based approach for consistent labeling of humans and objects in video
    Balcells, M
    DeMenthon, D
    Doermann, D
    PATTERN ANALYSIS AND APPLICATIONS, 2005, 7 (04) : 373 - 385
  • [50] An appearance-based approach for consistent labeling of humans and objects in video
    Martí Balcells
    Daniel DeMenthon
    David Doermann
    Pattern Analysis and Applications, 2004, 7 : 373 - 385