CycleSegNet: Object Co-Segmentation With Cycle Refinement and Region Correspondence

被引:12
|
作者
Zhang, Chi [1 ]
Li, Guankai [1 ]
Lin, Guosheng [1 ]
Wu, Qingyao [2 ,3 ]
Yao, Rui [4 ]
机构
[1] Nanyang Technol Univ NTU, Sch Comp Sci & Engn, Singapore 639798, Singapore
[2] South China Univ Technol, Sch Software Engn, Guangzhou 510640, Peoples R China
[3] Pazhou Lab, Guangzhou 510335, Peoples R China
[4] China Univ Min & Technol, Sch Comp Sci & Technol, Xuzhou 221116, Jiangsu, Peoples R China
基金
中国国家自然科学基金; 新加坡国家研究基金会;
关键词
Task analysis; Image segmentation; Semantics; Image representation; Predictive models; Neural networks; Visualization; Deep learning; co-segmentation; cycle refinement; attention;
D O I
10.1109/TIP.2021.3087401
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image co-segmentation is an active computer vision task that aims to segment the common objects from a set of images. Recently, researchers design various learning-based algorithms to undertake the co-segmentation task. The main difficulty in this task is how to effectively transfer information between images to make conditional predictions. In this paper, we present CycleSegNet, a novel framework for the co-segmentation task. Our network design has two key components: a region correspondence module which is the basic operation for exchanging information between local image regions, and a cycle refinement module, which utilizes ConvLSTMs to progressively update image representations and exchange information in a cycle and iterative manner. Extensive experiments demonstrate that our proposed method significantly outperforms the state-of-the-art methods on four popular benchmark datasets - PASCAL VOC dataset, MSRC dataset, Internet dataset, and iCoseg dataset, by 2.6%, 7.7%, 2.2%, and 2.9%, respectively.
引用
收藏
页码:5652 / 5664
页数:13
相关论文
共 50 条
  • [41] Unsupervised video co-segmentation based on superpixel co-saliency and region merging
    Guoheng Huang
    Chi-Man Pun
    Cong Lin
    Multimedia Tools and Applications, 2017, 76 : 12941 - 12964
  • [42] Unsupervised Multi-class Co-segmentation via Joint Object Detection and Segmentation with Energy Minimization
    Li, Lei
    Fei, Xuan
    Dong, Zhuoli
    Zhang, Dexian
    MIPPR 2015: AUTOMATIC TARGET RECOGNITION AND NAVIGATION, 2015, 9812
  • [43] Image Co-segmentation by Co-diffusion
    Liu, Liman
    Li, Kunqian
    Liao, Xiangli
    CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2017, 36 (11) : 4423 - 4440
  • [44] Image Co-segmentation by Co-diffusion
    Liman Liu
    Kunqian Li
    Xiangli Liao
    Circuits, Systems, and Signal Processing, 2017, 36 : 4423 - 4440
  • [45] Optimisation of linear dependence energy for object co-segmentation in a set of images with heterogeneous contents
    Merdassi, Hager
    Barhoumi, Walid
    Zagrouba, Ezzeddine
    IET IMAGE PROCESSING, 2020, 14 (01) : 201 - 210
  • [46] LCCo: Lending CLIP to co-segmentation
    Duan, Xin
    Yang, Yan
    Pan, Liyuan
    Liu, Xiabi
    PATTERN RECOGNITION, 2025, 161
  • [47] Co-segmentation of multiple similar images using saliency detection and region merging
    Zhou, Chongbo
    Liu, Chuancai
    IET COMPUTER VISION, 2014, 8 (03) : 254 - 261
  • [48] Automatic image co-segmentation: a survey
    Liu, Xiabi
    Duan, Xin
    MACHINE VISION AND APPLICATIONS, 2021, 32 (03)
  • [49] Hierarchical Co-Segmentation of building facades
    20151300674641
    (1) ESAT-PSI, VISICS, KU Leuven, Belgium, 1600, (Institute of Electrical and Electronics Engineers Inc., United States):
  • [50] Unsupervised Point Cloud Object Co-segmentation by Co-contrastive Learning and Mutual Attention Sampling
    Yang, Cheng-Kun
    Chuang, Yung-Yu
    Lin, Yen-Yu
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 7315 - 7324