Appearance-consistent Video Object Segmentation Based on a Multinomial Event Model

被引:4
|
作者
Chen, Yadang [1 ]
Hao, Chuanyan [2 ]
Liu, Alex X. [3 ,4 ]
Wu, Enhua [5 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Sch Educ Sci & Technol, Nanjing 210023, Jiangsu, Peoples R China
[3] Michigan State Univ, Dept Comp Sci & Engn, E Lansing, MI 48824 USA
[4] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210044, Jiangsu, Peoples R China
[5] Univ Chinese Acad Sci, Inst Software, State Key Lab Comp Sci, Beijing 100864, Peoples R China
基金
美国国家科学基金会; 中国国家自然科学基金;
关键词
Multinomial event model; appearance consistency; Markov random field; TRACKING;
D O I
10.1145/3321507
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this study, we propose an effective and efficient algorithm for unconstrained video object segmentation, which is achieved in a Markov random field (MRF). In the MRF graph, each node is modeled as a superpixel and labeled as either foreground or background during the segmentation process. The unary potential is computed for each node by learning a transductive SVM classifier under supervision by a few labeled frames. The pairwise potential is used for the spatial-temporal smoothness. In addition, a high-order potential based on the multinomial event model is employed to enhance the appearance consistency throughout the frames. To minimize this intractable feature, we also introduce a more efficient technique that simply extends the original MRF structure. The proposed approach was evaluated in experiments with different measures and the results based on a benchmark demonstrated its effectiveness compared with other state-of-the-art algorithms.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] A temporal attention based appearance model for video object segmentation
    Wang, Hui
    Liu, Weibin
    Xing, Weiwei
    APPLIED INTELLIGENCE, 2022, 52 (02) : 2290 - 2300
  • [2] A temporal attention based appearance model for video object segmentation
    Hui Wang
    Weibin Liu
    Weiwei Xing
    Applied Intelligence, 2022, 52 : 2290 - 2300
  • [3] A Generative Appearance Model for End-to-end Video Object Segmentation
    Johnander, Joakim
    Danelljan, Martin
    Brissman, Emil
    Khan, Fahad Shahbaz
    Felsberg, Michael
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 8945 - 8954
  • [4] Video object segmentation based on Gaussian mixture model
    School of Electronics and Information Engineering, Xi'an Jiaotong University, Xi'an 710049, China
    Hsi An Chiao Tung Ta Hsueh, 2006, 6 (724-728):
  • [5] Video object model and segmentation for content-based video indexing
    Zhong, D
    Chang, SF
    ISCAS '97 - PROCEEDINGS OF 1997 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS I - IV: CIRCUITS AND SYSTEMS IN THE INFORMATION AGE, 1997, : 1492 - 1495
  • [6] Feedback Learning Gaussian Appearance Network for Video Object Segmentation
    Wang L.
    Song H.-H.
    Zhang K.-H.
    Liu Q.-S.
    Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (03): : 834 - 842
  • [7] Fast Appearance Modeling for Automatic Primary Video Object Segmentation
    Yang, Jiong
    Price, Brian
    Shen, Xiaohui
    Lin, Zhe
    Yuan, Junsong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (02) : 503 - 515
  • [8] Temporally Consistent Referring Video Object Segmentation With Hybrid Memory
    Miao, Bo
    Bennamoun, Mohammed
    Gao, Yongsheng
    Shah, Mubarak
    Mian, Ajmal
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (11) : 11373 - 11385
  • [9] Video object segmentation with a Potts model
    Zhao, Jieyu
    Wang, Xiaoquan
    ICNC 2007: THIRD INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, VOL 2, PROCEEDINGS, 2007, : 742 - +
  • [10] Multilevel Model for Video Object Segmentation Based on Supervision Optimization
    Chen, Yadang
    Hao, Chuanyan
    Liu, Alex X.
    Wu, Enhua
    IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (08) : 1934 - 1945