Enhanced Attention Guided Teacher-Student Network for Weakly Supervised Object Detection

被引:0
|
作者
Li, Mingyang [1 ]
Gao, Ying [1 ]
Cai, Wentian [1 ]
Yang, Weixian [1 ]
Huang, Zihao [1 ]
Hu, Xiping [2 ]
Leung, Victor C. M. [3 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510000, Peoples R China
[2] Shenzhen MSU BIT Univ, Shenzhen 518000, Peoples R China
[3] Shenzhen Univ, Shenzhen 518000, Peoples R China
关键词
Weakly supervised learning; Object detection; Teacher-student; Attention mechanism;
D O I
10.1016/j.neucom.2024.127910
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly Supervised Object Detection (WSOD) has attracted increasing attention due to the convenience and low-cost of acquiring image-level annotations. Most existing WSOD methods follow Multiple Instance Learning (MIL) paradigm to select bounding boxes from proposals based on their classification scores. However, MILbased WSOD methods often focus on discriminative regions, leading to incomplete and missing instances. To address these issues, we introduce a novel WSOD framework named Enhanced Attention Guided Teacher- Student Network (EATSN). This framework aims to improve detection performance through the guidance of attention map and consistency learning. specifically, we initially train a teacher network using MIL process to generate pseudo ground-truth labels. Subsequently, the weak augmented and strong augmented images are fed into teacher and student models to produce the enhanced attention map. During the training iterations, pseudo labels are utilized to guide the student model, while the teacher model refines its parameters through the Exponential Moving Average(EMA) from the student. Finally we design a proposal selection method that leverages the enhanced attention map and bounding boxes scores to achieve better detection results. Experimental results on benchmark datasets demonstrate that our method achieves comparable performance.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] Unsupervised Anomaly Detection with Distillated Teacher-Student Network Ensemble
    Xiao, Qinfeng
    Wang, Jing
    Lin, Youfang
    Gongsa, Wenbo
    Hu, Ganghui
    Li, Menggang
    Wang, Fang
    ENTROPY, 2021, 23 (02) : 1 - 18
  • [22] Dual-attention Guided Dropblock Module for Weakly Supervised Object Localization
    Yin, Junhui
    Zhang, Siqing
    Chang, Dongliang
    Ma, Zhanyu
    Guo, Jun
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 4229 - 4236
  • [23] A semi-supervised Teacher-Student framework for surgical tool detection and localization
    Teevno, Mansoor Ali
    Ochoa-Ruiz, Gilberto
    Ali, Sharib
    COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING-IMAGING AND VISUALIZATION, 2023, 11 (04): : 1033 - 1041
  • [24] Enhanced Spatial Feature Learning for Weakly Supervised Object Detection
    Wu, Zhihao
    Wen, Jie
    Xu, Yong
    Yang, Jian
    Li, Xuelong
    Zhang, David
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (01) : 961 - 972
  • [25] Weakly Supervised Salient Object Detection by Hierarchically Enhanced Scribbles
    Wang, Xiongying
    Al-Huda, Zaid
    Peng, Bo
    Tang, Xin
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2023, 37 (02)
  • [26] Entropy guided attention network for weakly-supervised action localization
    Cheng, Yi
    Sun, Ying
    Fan, Hehe
    Zhuo, Tao
    Lim, Joo-Hwee
    Kankanhalli, Mohan
    PATTERN RECOGNITION, 2022, 129
  • [27] Pyramidal Multiple Instance Detection Network With Mask Guided Self-Correction for Weakly Supervised Object Detection
    Xu, Yunqiu
    Zhou, Chunluan
    Yu, Xin
    Xiao, Bin
    Yang, Yi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3029 - 3040
  • [28] Lifelong Teacher-Student Network Learning
    Ye, Fei
    Bors, Adrian G.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (10) : 6280 - 6296
  • [29] Negative Prototypes Guided Contrastive Learning for Weakly Supervised Object Detection
    Zhang, Yu
    Zhu, Chuang
    Yang, Guoqing
    Chen, Siqi
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, ECML PKDD 2023, PT II, 2023, 14170 : 36 - 51
  • [30] Self-Guided Proposal Generation for Weakly Supervised Object Detection
    Cheng, Gong
    Xie, Xuan
    Chen, Weining
    Feng, Xiaoxu
    Yao, Xiwen
    Han, Junwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60