CycleSegNet: Object Co-Segmentation With Cycle Refinement and Region Correspondence

被引:12
|
作者
Zhang, Chi [1 ]
Li, Guankai [1 ]
Lin, Guosheng [1 ]
Wu, Qingyao [2 ,3 ]
Yao, Rui [4 ]
机构
[1] Nanyang Technol Univ NTU, Sch Comp Sci & Engn, Singapore 639798, Singapore
[2] South China Univ Technol, Sch Software Engn, Guangzhou 510640, Peoples R China
[3] Pazhou Lab, Guangzhou 510335, Peoples R China
[4] China Univ Min & Technol, Sch Comp Sci & Technol, Xuzhou 221116, Jiangsu, Peoples R China
基金
中国国家自然科学基金; 新加坡国家研究基金会;
关键词
Task analysis; Image segmentation; Semantics; Image representation; Predictive models; Neural networks; Visualization; Deep learning; co-segmentation; cycle refinement; attention;
D O I
10.1109/TIP.2021.3087401
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image co-segmentation is an active computer vision task that aims to segment the common objects from a set of images. Recently, researchers design various learning-based algorithms to undertake the co-segmentation task. The main difficulty in this task is how to effectively transfer information between images to make conditional predictions. In this paper, we present CycleSegNet, a novel framework for the co-segmentation task. Our network design has two key components: a region correspondence module which is the basic operation for exchanging information between local image regions, and a cycle refinement module, which utilizes ConvLSTMs to progressively update image representations and exchange information in a cycle and iterative manner. Extensive experiments demonstrate that our proposed method significantly outperforms the state-of-the-art methods on four popular benchmark datasets - PASCAL VOC dataset, MSRC dataset, Internet dataset, and iCoseg dataset, by 2.6%, 7.7%, 2.2%, and 2.9%, respectively.
引用
收藏
页码:5652 / 5664
页数:13
相关论文
共 50 条
  • [1] A Survey of Object Co-Segmentation
    Lu, Zhoumin
    Xu, Haiping
    Liu, Genggeng
    IEEE ACCESS, 2019, 7 : 62875 - 62893
  • [2] Deep Object Co-segmentation
    Li, Weihao
    Jafari, Omid Hosseini
    Rother, Carsten
    COMPUTER VISION - ACCV 2018, PT III, 2019, 11363 : 638 - 653
  • [3] Object Co-skeletonization with Co-segmentation
    Jerripothula, Koteswar Rao
    Cai, Jianfei
    Lu, Jiangbo
    Yuan, Junsong
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 3881 - 3889
  • [4] Comprehensive Saliency Fusion for Object Co-segmentation
    Chhabra, Harshit Singh
    Jerripothula, Koteswar Rao
    23RD IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM 2021), 2021, : 107 - 110
  • [5] Weak Supervision Learning for Object Co-Segmentation
    Huang, Aiping
    Zhao, Tiesong
    IEEE TRANSACTIONS ON BIG DATA, 2020, 8 (04) : 1129 - 1140
  • [6] Object Co-Segmentation Using Image Processing
    Balaji, S.
    Praveen, John Paul A.
    Mohanraj, R.
    JOURNAL OF MECHANICS OF CONTINUA AND MATHEMATICAL SCIENCES, 2019, : 246 - 250
  • [7] Guided Co-Segmentation Network for Fast Video Object Segmentation
    Liu, Weide
    Lin, Guosheng
    Zhang, Tianyi
    Liu, Zichuan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (04) : 1607 - 1617
  • [8] Unsupervised co-segmentation through region matching
    Rubio, Jose C.
    Serrat, Joan
    Lopez, Antonio
    Paragios, Nikos
    2012 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2012, : 749 - 756
  • [9] Co-attention CNNs for Unsupervised Object Co-segmentation
    Hsu, Kuang-Jui
    Lin, Yen-Yu
    Chuang, Yung-Yu
    PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2018, : 748 - 756
  • [10] OBJECT CO-SEGMENTATION BASED ON DIRECTED GRAPH CLUSTERING
    Meng, Fanman
    Luo, Bing
    Huang, Chao
    2013 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (IEEE VCIP 2013), 2013,