Enhanced Attention Guided Teacher-Student Network for Weakly Supervised Object Detection

被引:0
|
作者
Li, Mingyang [1 ]
Gao, Ying [1 ]
Cai, Wentian [1 ]
Yang, Weixian [1 ]
Huang, Zihao [1 ]
Hu, Xiping [2 ]
Leung, Victor C. M. [3 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510000, Peoples R China
[2] Shenzhen MSU BIT Univ, Shenzhen 518000, Peoples R China
[3] Shenzhen Univ, Shenzhen 518000, Peoples R China
关键词
Weakly supervised learning; Object detection; Teacher-student; Attention mechanism;
D O I
10.1016/j.neucom.2024.127910
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly Supervised Object Detection (WSOD) has attracted increasing attention due to the convenience and low-cost of acquiring image-level annotations. Most existing WSOD methods follow Multiple Instance Learning (MIL) paradigm to select bounding boxes from proposals based on their classification scores. However, MILbased WSOD methods often focus on discriminative regions, leading to incomplete and missing instances. To address these issues, we introduce a novel WSOD framework named Enhanced Attention Guided Teacher- Student Network (EATSN). This framework aims to improve detection performance through the guidance of attention map and consistency learning. specifically, we initially train a teacher network using MIL process to generate pseudo ground-truth labels. Subsequently, the weak augmented and strong augmented images are fed into teacher and student models to produce the enhanced attention map. During the training iterations, pseudo labels are utilized to guide the student model, while the teacher model refines its parameters through the Exponential Moving Average(EMA) from the student. Finally we design a proposal selection method that leverages the enhanced attention map and bounding boxes scores to achieve better detection results. Experimental results on benchmark datasets demonstrate that our method achieves comparable performance.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] Attention-guided MIL weakly supervised visual anomaly detection
    Wang, Lin
    Wang, Xiangjun
    Liu, Feng
    Li, Mingyang
    Hao, Xin
    Zhao, Nianfu
    MEASUREMENT, 2023, 209
  • [32] Learning an Invariant and Equivariant Network for Weakly Supervised Object Detection
    Feng, Xiaoxu
    Yao, Xiwen
    Shen, Hui
    Cheng, Gong
    Xiao, Bin
    Han, Junwei
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (10) : 11977 - 11992
  • [33] Motion Context Network for Weakly Supervised Object Detection in Videos
    Jin, Ruibing
    Lin, Guosheng
    Wen, Changyun
    Wang, Jianliang
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 1864 - 1868
  • [34] Abnormal event detection by a weakly supervised temporal attention network
    Zheng, Xiangtao
    Zhang, Yichao
    Zheng, Yunpeng
    Luo, Fulin
    Lu, Xiaoqiang
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2022, 7 (03) : 419 - 431
  • [35] Multi-Layer Decoupling Attention Network for Weakly Supervised Object Localization
    Zhang, Aoran
    Ling, Zhigang
    Wang, Yaonan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 4469 - 4479
  • [36] A Weakly Supervised-Guided Soft Attention Network for Classification of Intracranial Hemorrhage
    Zhang, Long
    Miao, Wenlong
    Zhu, Chuang
    Wang, Yuanyuan
    Luo, Yihao
    Song, Ruoning
    Liu, Lian
    Yang, Jie
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2023, 15 (01) : 42 - 53
  • [37] PistonNet: Object Separating From Background by Attention for Weakly Supervised Ship Detection
    Yang, Yi
    Pan, Zongxu
    Hu, Yuxin
    Ding, Chibiao
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 5190 - 5202
  • [38] Guided Attention Network for Object Detection and Counting on Drones
    Cai, Yuanqiang
    Du, Dawei
    Zhang, Libo
    Wen, Longyin
    Wang, Weiqiang
    Wu, Yanjun
    Lyu, Siwei
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 709 - 717
  • [39] Semi-supervised teacher-student architecture for relation extraction
    Luo, Fan
    Nagesh, Ajay
    Sharp, Rebecca
    Surdeanu, Mihai
    NLP@NAACL-HLT 2019 - 3rd Workshop on Structured Prediction for NLP, Proceedings, 2021, : 29 - 37
  • [40] Uncertainty-Aware Graph-Guided Weakly Supervised Object Detection
    Zhu, Yueyi
    Zhang, Yongqiang
    Ding, Mingli
    Zuo, Wangmeng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (07) : 3257 - 3269