Rethinking erasing strategy on weakly supervised object localization

被引:0
|
作者
Fan, Yuming [1 ,2 ,3 ]
Wei, Shikui [1 ,2 ]
Tan, Chuangchuang [1 ,2 ]
Chen, Xiaotong [1 ,2 ]
Yang, Dongming [3 ]
Zhao, Yao [1 ,2 ]
机构
[1] Beijing Jiaotong Univ, Inst Informat Sci, Beijing 100044, Peoples R China
[2] Visual Intellgence X Int Cooperat Joint Lab MOE, Inst Informat Sci, Beijing, Peoples R China
[3] ChinaTelecom Cloud Technol Co Ltd, Beijing, Peoples R China
基金
国家重点研发计划;
关键词
Weakly supervised learning; Erasing strategy; Object localization;
D O I
10.1016/j.image.2025.117280
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Weakly supervised object localization (WSOL) is a challenging task that aims to locate object regions in images using image-level labels as supervision. Early research utilized erasing strategy to expand the localization regions. However, those methods usually adopt a fix threshold resulting in over- or under-fitting of the object region. Additionally, recent pseudo-label paradigm decouples the classification and localization tasks, causing confusion between foreground and background regions. In this paper, we propose the Soft-Erasing (SoE) method for Weakly Supervised Object Localization (WSOL). It includes two key modules: the Adaptive Erasing (AE) and Flip Erasing (FE). The AE module dynamically adjusts the erasing threshold using the object's structural information, while the noise information module ensures the classifier focuses on the foreground region. The FE module effectively decouples object and background information by using normalization and inversion techniques. Additionally, we introduce activation loss and reverse loss to strengthen semantic consistency in foreground regions. Experiments on public datasets demonstrate that our SoE framework significantly improves localization accuracy, achieving 70.86% on GT-Known Loc for ILSVRC and 95.84% for CUB-200-2011.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Feature disparity learning for weakly supervised object localization
    Li, Bingfeng
    Ruan, Haohao
    Li, Xinwei
    Wang, Keping
    IMAGE AND VISION COMPUTING, 2024, 145
  • [32] Weakly Supervised Object Localization Using Size Estimates
    Shi, Miaojing
    Ferrari, Vittorio
    COMPUTER VISION - ECCV 2016, PT V, 2016, 9909 : 105 - 121
  • [33] DANet: Divergent Activation for Weakly Supervised Object Localization
    Xue, Haolan
    Liu, Chang
    Wan, Fang
    Jiao, Jianbin
    Ji, Xiangyang
    Ye, Qixiang
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6588 - 6597
  • [34] ViTOL: Vision Transformer for Weakly Supervised Object Localization
    Gupta, Saurav
    Lakhotia, Sourav
    Rawat, Abhay
    Tallamraju, Rahul
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 4100 - 4109
  • [35] Shallow Feature Matters for Weakly Supervised Object Localization
    Wei, Jun
    Wang, Qin
    Li, Zhen
    Wang, Sheng
    Zhou, S. Kevin
    Cui, Shuguang
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 5989 - 5997
  • [36] Hierarchical complementary learning for weakly supervised object localization
    Benassou, Sabrina Narimene
    Shi, Wuzhen
    Jiang, Feng
    Benzine, Abdallah
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2022, 100
  • [37] Strengthen Learning Tolerance for Weakly Supervised Object Localization
    Guo, Guangyu
    Han, Junwei
    Wan, Fang
    Zhang, Dingwen
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 7399 - 7408
  • [38] Weakly Supervised Object Localization with Progressive Domain Adaptation
    Su, Shuochen
    Heide, Felix
    Swanson, Robin
    Klein, Jonathan
    Callenberg, Clara
    Hullin, Matthias
    Heidrich, Wolfgang
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : CP40 - CP40
  • [39] Background Activation Suppression for Weakly Supervised Object Localization
    Wu, Pingyu
    Zhai, Wei
    Cao, Yang
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 14228 - 14237
  • [40] Soft Proposal Networks for Weakly Supervised Object Localization
    Zhu, Yi
    Zhou, Yanzhao
    Ye, Qixiang
    Qiu, Qiang
    Jiao, Jianbin
    2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 1859 - 1868