Enhanced Attention Guided Teacher-Student Network for Weakly Supervised Object Detection

被引:0
|
作者
Li, Mingyang [1 ]
Gao, Ying [1 ]
Cai, Wentian [1 ]
Yang, Weixian [1 ]
Huang, Zihao [1 ]
Hu, Xiping [2 ]
Leung, Victor C. M. [3 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510000, Peoples R China
[2] Shenzhen MSU BIT Univ, Shenzhen 518000, Peoples R China
[3] Shenzhen Univ, Shenzhen 518000, Peoples R China
关键词
Weakly supervised learning; Object detection; Teacher-student; Attention mechanism;
D O I
10.1016/j.neucom.2024.127910
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly Supervised Object Detection (WSOD) has attracted increasing attention due to the convenience and low-cost of acquiring image-level annotations. Most existing WSOD methods follow Multiple Instance Learning (MIL) paradigm to select bounding boxes from proposals based on their classification scores. However, MILbased WSOD methods often focus on discriminative regions, leading to incomplete and missing instances. To address these issues, we introduce a novel WSOD framework named Enhanced Attention Guided Teacher- Student Network (EATSN). This framework aims to improve detection performance through the guidance of attention map and consistency learning. specifically, we initially train a teacher network using MIL process to generate pseudo ground-truth labels. Subsequently, the weak augmented and strong augmented images are fed into teacher and student models to produce the enhanced attention map. During the training iterations, pseudo labels are utilized to guide the student model, while the teacher model refines its parameters through the Exponential Moving Average(EMA) from the student. Finally we design a proposal selection method that leverages the enhanced attention map and bounding boxes scores to achieve better detection results. Experimental results on benchmark datasets demonstrate that our method achieves comparable performance.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] A Novel Teacher-Student Network for Sentiment Classification
    Chen, Huajie
    Wang, Eric Ke
    Li, Feng
    Yu, Wenli
    PROCEEDINGS OF THE 2016 2ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND INDUSTRIAL ENGINEERING (AIIE 2016), 2016, 133 : 507 - 512
  • [42] FI-WSOD: Foreground Information Guided Weakly Supervised Object Detection
    Yin, Yufei
    Deng, Jiajun
    Zhou, Wengang
    Li, Li
    Li, Houqiang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1890 - 1902
  • [43] Saliency Guided End-to-End Learning for Weakly Supervised Object Detection
    Lai, Baisheng
    Gong, Xiaojin
    PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2017, : 2053 - 2059
  • [44] Weakly Supervised Object Detection in Artworks
    Gonthier, Nicolas
    Gousseau, Yann
    Ladjal, Said
    Bonfait, Olivier
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT II, 2019, 11130 : 692 - 709
  • [45] Misclassification in Weakly Supervised Object Detection
    Wu, Zhihao
    Xu, Yong
    Yang, Jian
    Li, Xuelong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 3413 - 3427
  • [46] Semi-weakly Supervised Learning for Prostate Cancer Image Classification with Teacher-Student Deep Convolutional Networks
    Otalora, Sebastian
    Marini, Niccolo
    Mueller, Henning
    Atzori, Manfredo
    INTERPRETABLE AND ANNOTATION-EFFICIENT LEARNING FOR MEDICAL IMAGE COMPUTING, IMIMIC 2020, MIL3ID 2020, LABELS 2020, 2020, 12446 : 193 - 203
  • [47] Scribble-attention hierarchical network for weakly supervised salient object detection in optical remote sensing images
    Ma, Lei
    Luo, Xinyi
    Hong, Hanyu
    Zhang, Yaozong
    Wang, Lei
    Wu, Jinmeng
    APPLIED INTELLIGENCE, 2023, 53 (10) : 12999 - 13017
  • [48] Scribble-attention hierarchical network for weakly supervised salient object detection in optical remote sensing images
    Lei Ma
    Xinyi Luo
    Hanyu Hong
    Yaozong Zhang
    Lei Wang
    Jinmeng Wu
    Applied Intelligence, 2023, 53 : 12999 - 13017
  • [49] Multi-view Teacher-Student Network
    Tian, Yingjie
    Sun, Shiding
    Tang, Jingjing
    NEURAL NETWORKS, 2022, 146 : 69 - 84
  • [50] Complementary Mask Self-Supervised Pre-training Based on Teacher-Student Network
    Ye, Shaoxiong
    Huang, Jing
    Zhu, Lifu
    2023 3RD ASIA-PACIFIC CONFERENCE ON COMMUNICATIONS TECHNOLOGY AND COMPUTER SCIENCE, ACCTCS, 2023, : 199 - 206