CycleSegNet: Object Co-Segmentation With Cycle Refinement and Region Correspondence

被引:12
|
作者
Zhang, Chi [1 ]
Li, Guankai [1 ]
Lin, Guosheng [1 ]
Wu, Qingyao [2 ,3 ]
Yao, Rui [4 ]
机构
[1] Nanyang Technol Univ NTU, Sch Comp Sci & Engn, Singapore 639798, Singapore
[2] South China Univ Technol, Sch Software Engn, Guangzhou 510640, Peoples R China
[3] Pazhou Lab, Guangzhou 510335, Peoples R China
[4] China Univ Min & Technol, Sch Comp Sci & Technol, Xuzhou 221116, Jiangsu, Peoples R China
基金
中国国家自然科学基金; 新加坡国家研究基金会;
关键词
Task analysis; Image segmentation; Semantics; Image representation; Predictive models; Neural networks; Visualization; Deep learning; co-segmentation; cycle refinement; attention;
D O I
10.1109/TIP.2021.3087401
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image co-segmentation is an active computer vision task that aims to segment the common objects from a set of images. Recently, researchers design various learning-based algorithms to undertake the co-segmentation task. The main difficulty in this task is how to effectively transfer information between images to make conditional predictions. In this paper, we present CycleSegNet, a novel framework for the co-segmentation task. Our network design has two key components: a region correspondence module which is the basic operation for exchanging information between local image regions, and a cycle refinement module, which utilizes ConvLSTMs to progressively update image representations and exchange information in a cycle and iterative manner. Extensive experiments demonstrate that our proposed method significantly outperforms the state-of-the-art methods on four popular benchmark datasets - PASCAL VOC dataset, MSRC dataset, Internet dataset, and iCoseg dataset, by 2.6%, 7.7%, 2.2%, and 2.9%, respectively.
引用
收藏
页码:5652 / 5664
页数:13
相关论文
共 50 条
  • [21] Extensible image object co-segmentation with sparse cooperative relations
    Li, Kunqian
    Qi, Shengbo
    Yang, Hua
    Zhou, Liqin
    Song, Dalei
    INFORMATION SCIENCES, 2020, 521 : 422 - 434
  • [22] Channel and spatial attention based deep object co-segmentation
    Chen, Jia
    Chen, Yasong
    Li, Weihao
    Ning, Guoqin
    Tong, Mingwen
    Hilton, Adrian
    Knowledge-Based Systems, 2021, 211
  • [23] Video Object Co-segmentation by Regulated Maximum Weight Cliques
    Zhang, Dong
    Javed, Omar
    Shah, Mubarak
    COMPUTER VISION - ECCV 2014, PT VII, 2014, 8695 : 551 - 566
  • [24] Video Object Discovery and Co-Segmentation with Extremely Weak Supervision
    Wang, Le
    Hua, Gang
    Sukthankar, Rahul
    Xue, Jianru
    Niu, Zhenxing
    Zheng, Nanning
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (10) : 2074 - 2088
  • [25] Object co-segmentation via weakly supervised data fusion
    Wang, Shiping
    Zhang, Handuo
    Wang, Han
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2017, 155 : 43 - 54
  • [26] Co-Segmentation by Composition
    Faktor, Alon
    Irani, Michal
    2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 1297 - 1304
  • [27] Deep-dense Conditional Random Fields for Object Co-segmentation
    Yuan, Zehuan
    Lu, Tong
    Wu, Yirui
    PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 3371 - 3377
  • [28] Object-based RGBD Image Co-segmentation with Mutex Constraint
    Fu, Huazhu
    Xu, Dong
    Lin, Stephen
    Liu, Jiang
    2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 4428 - 4436
  • [29] Shape based Co-segmentation repairing by Segment Evaluation and Object Proposals
    Shi, Wen
    Zhu, Hongyuan
    Yang, Li
    Luo, Yuanqing
    2016 30TH ANNIVERSARY OF VISUAL COMMUNICATION AND IMAGE PROCESSING (VCIP), 2016,
  • [30] Using Visual Segments and Spatial Layouts for Unsupervised Object Co-segmentation
    Sun, Linjia
    Liang, Xiaohui
    Liu, Min
    2013 IEEE INTERNATIONAL CONFERENCE ON IMAGING SYSTEMS AND TECHNIQUES (IST 2013), 2013, : 200 - 205