Rethinking erasing strategy on weakly supervised object localization

被引:0
|
作者
Fan, Yuming [1 ,2 ,3 ]
Wei, Shikui [1 ,2 ]
Tan, Chuangchuang [1 ,2 ]
Chen, Xiaotong [1 ,2 ]
Yang, Dongming [3 ]
Zhao, Yao [1 ,2 ]
机构
[1] Beijing Jiaotong Univ, Inst Informat Sci, Beijing 100044, Peoples R China
[2] Visual Intellgence X Int Cooperat Joint Lab MOE, Inst Informat Sci, Beijing, Peoples R China
[3] ChinaTelecom Cloud Technol Co Ltd, Beijing, Peoples R China
基金
国家重点研发计划;
关键词
Weakly supervised learning; Erasing strategy; Object localization;
D O I
10.1016/j.image.2025.117280
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Weakly supervised object localization (WSOL) is a challenging task that aims to locate object regions in images using image-level labels as supervision. Early research utilized erasing strategy to expand the localization regions. However, those methods usually adopt a fix threshold resulting in over- or under-fitting of the object region. Additionally, recent pseudo-label paradigm decouples the classification and localization tasks, causing confusion between foreground and background regions. In this paper, we propose the Soft-Erasing (SoE) method for Weakly Supervised Object Localization (WSOL). It includes two key modules: the Adaptive Erasing (AE) and Flip Erasing (FE). The AE module dynamically adjusts the erasing threshold using the object's structural information, while the noise information module ensures the classifier focuses on the foreground region. The FE module effectively decouples object and background information by using normalization and inversion techniques. Additionally, we introduce activation loss and reverse loss to strengthen semantic consistency in foreground regions. Experiments on public datasets demonstrate that our SoE framework significantly improves localization accuracy, achieving 70.86% on GT-Known Loc for ILSVRC and 95.84% for CUB-200-2011.
引用
收藏
页数:11
相关论文
共 50 条
  • [11] Generalized Weakly Supervised Object Localization
    Zhang, Dingwen
    Guo, Guangyu
    Zeng, Wenyuan
    Li, Lei
    Han, Junwei
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (04) : 5395 - 5406
  • [12] Rethinking Segmentation Guidance for Weakly Supervised Object Detection
    Yang, Ke
    Zhang, Peng
    Qiao, Peng
    Wang, Zhiyuan
    Dai, Huadong
    Shen, Tianlong
    Li, Dongsheng
    Dou, Yong
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 4069 - 4073
  • [13] Weakly supervised object localization and segmentation in videos
    Rochan, Mrigank
    Rahman, Shafin
    Bruce, Neil D. B.
    Wang, Yang
    IMAGE AND VISION COMPUTING, 2016, 56 : 1 - 12
  • [14] Weakly Supervised Object Localization as Domain Adaption
    Zhu, Lei
    She, Qi
    Chen, Qian
    You, Yunfei
    Wang, Boyu
    Lu, Yanye
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 14617 - 14626
  • [15] Weakly Supervised Object Localization with Stable Segmentations
    Galleguillos, Carolina
    Babenko, Boris
    Rabinovich, Andrew
    Belongie, Serge
    COMPUTER VISION - ECCV 2008, PT I, PROCEEDINGS, 2008, 5302 : 193 - 207
  • [16] Adversarial Transformers for Weakly Supervised Object Localization
    Meng, Meng
    Zhang, Tianzhu
    Zhang, Zhe
    Zhang, Yongdong
    Wu, Feng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 7130 - 7143
  • [17] Adversarial Transformers for Weakly Supervised Object Localization
    Meng, Meng
    Zhang, Tianzhu
    Zhang, Zhe
    Zhang, Yongdong
    Wu, Feng
    IEEE Transactions on Image Processing, 2022, 31 : 7130 - 7143
  • [18] SALIENCY AWARE: WEAKLY SUPERVISED OBJECT LOCALIZATION
    Chen, Yun-Chun
    Hsu, Winston H.
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 1907 - 1911
  • [19] Weakly Supervised Object Localization and Detection: A Survey
    Zhang, Dingwen
    Han, Junwei
    Cheng, Gong
    Yang, Ming-Hsuan
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) : 5866 - 5885
  • [20] Entropy regularization for weakly supervised object localization
    Hwang, Dongjun
    Ha, Jung-Woo
    Shim, Hyunjung
    Choe, Junsuk
    PATTERN RECOGNITION LETTERS, 2023, 169 : 1 - 7