AAR:Attention Remodulation for Weakly Supervised Semantic Segmentation

被引:0
|
作者
Yu-e Lin
Houguo Li
Xingzhu Liang
Mengfan Li
Huilin Liu
机构
[1] Anhui University of Science and Technology,School of Computer Science and Engineering
[2] Anhui University of Science and Technology,Institute of Environment
来源
The Journal of Supercomputing | 2024年 / 80卷
关键词
Weakly supervised semantic segmentation; Attention activation; Feature pixels;
D O I
暂无
中图分类号
学科分类号
摘要
Weakly Supervised Semantic Segmentation is a crucial task in computer vision. However, existing methods that utilize Class Activation Maps (CAMs) with classification tasks can only identify a small part of the region. To address this limitation, we propose a novel Attention Activation Remodulation (AAR) scheme that leverages traditional CAMs and the remodulation branch to obtain weighted CAMs for recalibrated supervision. The AAR scheme re-arranges important features’ distribution from the channel and space perspectives, which regulates segmentation-oriented activation responses. In addition, we propose a Feature Pixel Extraction Module (FPEM) that utilizes contextual information to improve pixel prediction. Furthermore, the proposed scheme can be combined with other methods to improve overall performance. Extensive experiments on the PASCAL VOC 2012 dataset demonstrate the effectiveness of the AAR mechanism and FPEM module.
引用
收藏
页码:9096 / 9114
页数:18
相关论文
共 50 条
  • [31] Multi-layered self-attention mechanism for weakly supervised semantic segmentation
    Yaganapu, Avinash
    Kang, Mingon
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 239
  • [32] Semantic-Aware Superpixel for Weakly Supervised Semantic Segmentation
    Kim, Sangtae
    Park, Daeyoung
    Shim, Byonghyo
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 1, 2023, : 1142 - 1150
  • [33] Regional Semantic Contrast and Aggregation for Weakly Supervised Semantic Segmentation
    Zhou, Tianfei
    Zhang, Meijie
    Zhao, Fang
    Li, Jianwu
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 4289 - 4299
  • [34] L2A: Learning Affinity From Attention for Weakly Supervised Continual Semantic Segmentation
    Liu, Hao
    Zhou, Yong
    Liu, Bing
    Yan, Ming
    Zhou, Joey Tianyi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (01) : 315 - 328
  • [35] Self-Attention Prediction Correction with Channel Suppression for Weakly-Supervised Semantic Segmentation
    Sun, Guoying
    Yang, Meng
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 846 - 851
  • [36] Attention-Based Dropout Layer for Weakly Supervised Single Object Localization and Semantic Segmentation
    Choe, Junsuk
    Lee, Seungho
    Shim, Hyunjung
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (12) : 4256 - 4271
  • [37] Improved sub-category exploration and attention hybrid network for weakly supervised semantic segmentation
    Hegui Zhu
    Tian Geng
    Jiayi Wang
    Qingsong Tang
    Wuming Jiang
    Neural Computing and Applications, 2023, 35 : 10573 - 10587
  • [38] Box-driven Weakly Supervised Images Semantic Segmentation Algorithm Based on Attention Model
    Liu, Jianxin
    Geng, Yushui
    Zhao, Jing
    Li, Wenxiao
    Zhang, Kang
    2021 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2021, : 1797 - 1802
  • [39] Gradient-coupled cross-patch attention map for weakly supervised semantic segmentation
    Cao, Zhiyuan
    Zhang, Jiacai
    NEUROCOMPUTING, 2023, 535 : 83 - 96
  • [40] Saliency Guided Self-Attention Network for Weakly and Semi-Supervised Semantic Segmentation
    Yao, Qi
    Gong, Xiaojin
    IEEE ACCESS, 2020, 8 : 14413 - 14423