Rethinking erasing strategy on weakly supervised object localization

被引:0
|
作者
Fan, Yuming [1 ,2 ,3 ]
Wei, Shikui [1 ,2 ]
Tan, Chuangchuang [1 ,2 ]
Chen, Xiaotong [1 ,2 ]
Yang, Dongming [3 ]
Zhao, Yao [1 ,2 ]
机构
[1] Beijing Jiaotong Univ, Inst Informat Sci, Beijing 100044, Peoples R China
[2] Visual Intellgence X Int Cooperat Joint Lab MOE, Inst Informat Sci, Beijing, Peoples R China
[3] ChinaTelecom Cloud Technol Co Ltd, Beijing, Peoples R China
基金
国家重点研发计划;
关键词
Weakly supervised learning; Erasing strategy; Object localization;
D O I
10.1016/j.image.2025.117280
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Weakly supervised object localization (WSOL) is a challenging task that aims to locate object regions in images using image-level labels as supervision. Early research utilized erasing strategy to expand the localization regions. However, those methods usually adopt a fix threshold resulting in over- or under-fitting of the object region. Additionally, recent pseudo-label paradigm decouples the classification and localization tasks, causing confusion between foreground and background regions. In this paper, we propose the Soft-Erasing (SoE) method for Weakly Supervised Object Localization (WSOL). It includes two key modules: the Adaptive Erasing (AE) and Flip Erasing (FE). The AE module dynamically adjusts the erasing threshold using the object's structural information, while the noise information module ensures the classifier focuses on the foreground region. The FE module effectively decouples object and background information by using normalization and inversion techniques. Additionally, we introduce activation loss and reverse loss to strengthen semantic consistency in foreground regions. Experiments on public datasets demonstrate that our SoE framework significantly improves localization accuracy, achieving 70.86% on GT-Known Loc for ILSVRC and 95.84% for CUB-200-2011.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Rethinking the Localization in Weakly Supervised Object Localization
    Xu, Rui
    Luo, Yong
    Hu, Han
    Du, Bo
    Shen, Jialie
    Wen, Yonggang
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 5484 - 5494
  • [2] Aggregation of attention and erasing for weakly supervised object localization
    Koo, Bongyeong
    Choi, Han-Soo
    Kang, Myungjoo
    IMAGE AND VISION COMPUTING, 2023, 129
  • [3] Improving weakly-supervised object localization using adversarial erasing and label
    Kang, Byeongkeun
    Cha, Sinhae
    Lee, Yeejin
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 133
  • [4] Improving weakly-supervised object localization using adversarial erasing and pseudo label
    Kang, Byeongkeun
    Cha, Sinhae
    Lee, Yeejin
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 133
  • [5] Weakly Supervised Object Localization with Background Suppression Erasing for Art Authentication and Copyright Protection
    Wu, Chaojie
    Li, Mingyang
    Gao, Ying
    Xie, Xinyan
    Ng, Wing W. Y.
    Musyafa, Ahmad
    MACHINE INTELLIGENCE RESEARCH, 2024, 21 (01) : 89 - 103
  • [6] Weakly Supervised Object Localization with Background Suppression Erasing for Art Authentication and Copyright Protection
    Chaojie Wu
    Mingyang Li
    Ying Gao
    Xinyan Xie
    Wing W. Y. Ng
    Ahmad Musyafa
    Machine Intelligence Research, 2024, 21 : 89 - 103
  • [7] Improving weakly-supervised object localization using adversarial erasing and pseudo label
    Kang B.
    Cha S.
    Lee Y.
    Engineering Applications of Artificial Intelligence, 2024, 133
  • [8] Attention Erasing and Instance Sampling for Weakly Supervised Object Detection
    Xie, Xuan
    Cheng, Gong
    Feng, Xiaoxu
    Yao, Xiwen
    Qian, Xiaoliang
    Han, Junwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 10
  • [9] Attention-based Selection Strategy for Weakly Supervised Object Localization
    Zhang, Zhenfei
    Bui, Tien D.
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 10305 - 10311
  • [10] Weakly supervised object localization with soft guidance and channel erasing for auto labelling in autonomous driving systems
    Xie, Xinyan
    Li, Yijiang
    Gao, Ying
    Wu, Chaojie
    Gao, Ping
    Song, Binjie
    Wang, Wei
    Lu, Yiqin
    ISA TRANSACTIONS, 2023, 132 : 39 - 51