Appearance-consistent Video Object Segmentation Based on a Multinomial Event Model

被引:4
|
作者
Chen, Yadang [1 ]
Hao, Chuanyan [2 ]
Liu, Alex X. [3 ,4 ]
Wu, Enhua [5 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Sch Educ Sci & Technol, Nanjing 210023, Jiangsu, Peoples R China
[3] Michigan State Univ, Dept Comp Sci & Engn, E Lansing, MI 48824 USA
[4] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210044, Jiangsu, Peoples R China
[5] Univ Chinese Acad Sci, Inst Software, State Key Lab Comp Sci, Beijing 100864, Peoples R China
基金
美国国家科学基金会; 中国国家自然科学基金;
关键词
Multinomial event model; appearance consistency; Markov random field; TRACKING;
D O I
10.1145/3321507
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this study, we propose an effective and efficient algorithm for unconstrained video object segmentation, which is achieved in a Markov random field (MRF). In the MRF graph, each node is modeled as a superpixel and labeled as either foreground or background during the segmentation process. The unary potential is computed for each node by learning a transductive SVM classifier under supervision by a few labeled frames. The pairwise potential is used for the spatial-temporal smoothness. In addition, a high-order potential based on the multinomial event model is employed to enhance the appearance consistency throughout the frames. To minimize this intractable feature, we also introduce a more efficient technique that simply extends the original MRF structure. The proposed approach was evaluated in experiments with different measures and the results based on a benchmark demonstrated its effectiveness compared with other state-of-the-art algorithms.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] MEM: Mask Enhancement Model for Video Object Segmentation
    Abdelfattah, Islam
    Shehata, Mohamed S.
    ADVANCES IN VISUAL COMPUTING, ISVC 2024, PT I, 2025, 15046 : 262 - 274
  • [32] Model based video segmentation
    Li, DL
    Lu, HQ
    2000 IEEE WORKSHOP ON SIGNAL PROCESSING SYSTEMS: DESIGN AND IMPLEMENTATION, 2000, : 120 - 129
  • [33] Automatic segmentation of video object plane based on object tracking and matching
    Shi, L
    Zhang, ZY
    An, P
    PROCEEDINGS OF 2001 INTERNATIONAL SYMPOSIUM ON INTELLIGENT MULTIMEDIA, VIDEO AND SPEECH PROCESSING, 2001, : 510 - 513
  • [34] Automatic segmentation of video object plane based on object tracking and matching
    Shi, L
    Zhang, ZY
    Wang, H
    IMAGE EXTRACTION, SEGMENTATION, AND RECOGNITION, 2001, 4550 : 28 - 33
  • [35] Video object segmentation based on grey-consecutive regions segmentation
    Chen, Han-Feng
    Qi, Fei-Hu
    Hongwai Yu Haomibo Xuebao/Journal of Infrared and Millimeter Waves, 2002, 21 (03): : 195 - 199
  • [36] Video object segmentation based on grey-consecutive regions segmentation
    Chen, HF
    Qi, FH
    JOURNAL OF INFRARED AND MILLIMETER WAVES, 2002, 21 (03) : 195 - 199
  • [37] Video object segmentation and tracking for content-based video coding
    Zhou, JY
    Ong, EP
    Ko, CC
    2000 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, PROCEEDINGS VOLS I-III, 2000, : 1555 - 1558
  • [38] Video Object Detection and Segmentation Based on Proposal Boxes
    Zhang, Xiaodi
    Cao, Zhiguo
    Xiao, Yang
    Zhao, Furong
    PATTERN RECOGNITION (CCPR 2016), PT I, 2016, 662 : 304 - 317
  • [39] Attention-based video object segmentation algorithm
    Cao, Ying
    Sun, Lijuan
    Han, Chong
    Guo, Jian
    IET IMAGE PROCESSING, 2021, 15 (08) : 1668 - 1678
  • [40] SEMIAUTOMATIC VIDEO OBJECT SEGMENTATION BASED BACKGROUND CONSTRUCTING
    Zhang, Yongjian
    Kang, Yanmei
    Hou, Youguo
    Wang, Dongyu
    2011 4TH IEEE INTERNATIONAL CONFERENCE ON BROADBAND NETWORK AND MULTIMEDIA TECHNOLOGY (4TH IEEE IC-BNMT2011), 2011, : 260 - 264