Rethinking erasing strategy on weakly supervised object localization

被引:0
|
作者
Fan, Yuming [1 ,2 ,3 ]
Wei, Shikui [1 ,2 ]
Tan, Chuangchuang [1 ,2 ]
Chen, Xiaotong [1 ,2 ]
Yang, Dongming [3 ]
Zhao, Yao [1 ,2 ]
机构
[1] Beijing Jiaotong Univ, Inst Informat Sci, Beijing 100044, Peoples R China
[2] Visual Intellgence X Int Cooperat Joint Lab MOE, Inst Informat Sci, Beijing, Peoples R China
[3] ChinaTelecom Cloud Technol Co Ltd, Beijing, Peoples R China
基金
国家重点研发计划;
关键词
Weakly supervised learning; Erasing strategy; Object localization;
D O I
10.1016/j.image.2025.117280
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Weakly supervised object localization (WSOL) is a challenging task that aims to locate object regions in images using image-level labels as supervision. Early research utilized erasing strategy to expand the localization regions. However, those methods usually adopt a fix threshold resulting in over- or under-fitting of the object region. Additionally, recent pseudo-label paradigm decouples the classification and localization tasks, causing confusion between foreground and background regions. In this paper, we propose the Soft-Erasing (SoE) method for Weakly Supervised Object Localization (WSOL). It includes two key modules: the Adaptive Erasing (AE) and Flip Erasing (FE). The AE module dynamically adjusts the erasing threshold using the object's structural information, while the noise information module ensures the classifier focuses on the foreground region. The FE module effectively decouples object and background information by using normalization and inversion techniques. Additionally, we introduce activation loss and reverse loss to strengthen semantic consistency in foreground regions. Experiments on public datasets demonstrate that our SoE framework significantly improves localization accuracy, achieving 70.86% on GT-Known Loc for ILSVRC and 95.84% for CUB-200-2011.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Normalization Matters in Weakly Supervised Object Localization
    Kim, Jeesoo
    Choe, Junsuk
    Yun, Sangdoo
    Kwak, Nojun
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 3407 - 3416
  • [22] Feature Fusion for Weakly Supervised Object Localization
    Tang, Xu
    Song, Yonghong
    Zhang, Yuanlin
    2018 CHINESE AUTOMATION CONGRESS (CAC), 2018, : 2548 - 2553
  • [23] Convolutional STN for Weakly Supervised Object Localization
    Meethal, Akhil
    Pedersoli, Marco
    Belharbi, Soufiane
    Granger, Eric
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 10157 - 10164
  • [24] Human-Like Delicate Region Erasing Strategy for Weakly Supervised Detection
    En, Qing
    Duan, Lijuan
    Zhang, Zhaoxiang
    Bai, Xiang
    Zhang, Yundong
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 3502 - 3509
  • [25] Foreground Activation Maps for Weakly Supervised Object Localization
    Meng, Meng
    Zhang, Tianzhu
    Tian, Qi
    Zhang, Yongdong
    Wu, Feng
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 3365 - 3375
  • [26] Adaptive attention augmentor for weakly supervised object localization
    Zhang, Longhao
    Yang, Huihua
    NEUROCOMPUTING, 2021, 454 : 474 - 482
  • [27] Weakly Supervised Object Localization with Latent Category Learning
    Wang, Chong
    Ren, Weiqiang
    Huang, Kaiqi
    Tan, Tieniu
    COMPUTER VISION - ECCV 2014, PT VI, 2014, 8694 : 431 - 445
  • [28] Token Masking Transformer for Weakly Supervised Object Localization
    Xu, Wenhao
    Wang, Changwei
    Xu, Rongtao
    Xu, Shibiao
    Meng, Weiliang
    Zhang, Man
    Zhang, Xiaopeng
    IEEE TRANSACTIONS ON MULTIMEDIA, 2025, 27 : 2059 - 2069
  • [29] Evaluating Weakly Supervised Object Localization Methods Right
    Choe, Junsuk
    Oh, Seong Joon
    Lee, Seungho
    Chun, Sanghyuk
    Akata, Zeynep
    Shim, Hyunjung
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 3130 - 3139
  • [30] Progressive Representation Adaptation for Weakly Supervised Object Localization
    Li, Dong
    Huang, Jia-Bin
    Li, Yali
    Wang, Shengjin
    Yang, Ming-Hsuan
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (06) : 1424 - 1438