BAProto: Boundary-Aware Prototype for High-quality Instance Segmentation

被引:0
|
作者
Zhang, Yuxuan [1 ]
Yang, Wei [1 ,2 ,3 ]
Hu, Rong [1 ]
机构
[1] Univ Sci & Technol China, Sch Comp Sci & Technol, Hefei, Peoples R China
[2] Univ Sci & Technol China, Suzhou Inst Adv Res, Suzhou, Peoples R China
[3] Hefei Natl Lab, Hefei, Peoples R China
基金
中国国家自然科学基金;
关键词
Instance segmentation; Boundary refinement; Boundary-Aware Prototype; Segmentation loss;
D O I
10.1109/ICME55011.2023.00398
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To date, the boundary quality remains unsatisfactory in instance segmentation, resulting in increasing attention to the mask refinement mechanism. Such a mechanism is supposed to be accurate, efficient and generic to the existing models. Yet, few methods met the three factors simultaneously. In this paper, to address this issue, we propose a Boundary-Aware Prototype (BAProto) for boundary refinement, which conducts pixel-wise prediction through the similarity of boundary representation and the specific prototype. Such a prototype is obtained by a memory unit for comprehensive learning. To our best knowledge, BAProto is the first approach that satisfies the above three factors at the same time. In particular, we elaborately design a three-phase segmentation loss, focusing on the learning of different regions to extract discriminating boundary representations for prototype establishment. Extensive experimental results show that BAProto is precise, efficient and model-agnostic on COCO and Cityscapes datasets.
引用
收藏
页码:2333 / 2338
页数:6
相关论文
共 50 条
  • [1] Boundary-aware Instance Segmentation
    Hayder, Zeeshan
    He, Xuming
    Salzmann, Mathieu
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 587 - 595
  • [2] BSOLO: BOUNDARY-AWARE ONE-STAGE INSTANCE SEGMENTATION SOLO
    Zhang, Yuxuan
    Yang, Wei
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2594 - 2598
  • [3] GCBANet: A Global Context Boundary-Aware Network for SAR Ship Instance Segmentation
    Ke, Xiao
    Zhang, Xiaoling
    Zhang, Tianwen
    [J]. REMOTE SENSING, 2022, 14 (09)
  • [4] Boundary-aware dichotomous image segmentation
    Tang, Haonan
    Chen, Shuhan
    Liu, Yang
    Wang, Shiyu
    Chen, Zeyu
    Hu, Xuelong
    [J]. VISUAL COMPUTER, 2024,
  • [5] Boundary-Aware CNN for Semantic Segmentation
    Zou, Nan
    Xiang, Zhiyu
    Chen, Yiman
    Chen, Shuya
    Qiao, Chengyu
    [J]. IEEE ACCESS, 2019, 7 : 114520 - 114528
  • [6] BASS: Boundary-Aware Superpixel Segmentation
    Rubio, Antonio
    Yu, LongLong
    Simo-Serra, Edgar
    Moreno-Noguer, Francesc
    [J]. 2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 2824 - 2829
  • [7] BRefine: Achieving High-Quality Instance Segmentation
    Yu, Jimin
    Yang, Xiankun
    Zhou, Shangbo
    Wang, Shougang
    Hu, Shangguo
    [J]. SENSORS, 2022, 22 (17)
  • [8] Mask Transfiner for High-Quality Instance Segmentation
    Ke, Lei
    Danelljan, Martin
    Li, Xia
    Tai, Yu-Wing
    Tang, Chi-Keung
    Yu, Fisher
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 4402 - 4411
  • [9] Boundary-Aware Network for Kidney Tumor Segmentation
    Hu, Shishuai
    Zhang, Jianpeng
    Xia, Yong
    [J]. MACHINE LEARNING IN MEDICAL IMAGING, MLMI 2020, 2020, 12436 : 189 - 198
  • [10] Boundary-aware Graph Convolution for Semantic Segmentation
    Hu, Hanzhe
    Cui, Jinshi
    Zha, Hongbin
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 1828 - 1835