Adaptive Zone Learning for Weakly Supervised Object Localization

被引:0
|
作者
Chen, Zhiwei [1 ]
Wang, Siwei [1 ]
Cao, Liujuan [1 ]
Shen, Yunhang [2 ]
Ji, Rongrong [1 ]
机构
[1] Xiamen Univ, Key Lab Multimedia Trusted Percept & Efficient Com, Minist Educ China, Xiamen 361005, Peoples R China
[2] Tencent Co Ltd, YouTu Lab, Shanghai 518064, Peoples R China
关键词
Location awareness; Feature extraction; Learning systems; Cams; Task analysis; Annotations; Generators; Class activation maps (CAMs); foreground prediction maps (FPMs); object localization; weakly supervised learning; NETWORK;
D O I
10.1109/TNNLS.2024.3392948
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly supervised object localization (WSOL) stands as a pivotal endeavor within the realm of computer vision, entailing the location of objects utilizing merely image-level labels. Contemporary approaches in WSOL have leveraged FPMs, yielding commendable outcomes. However, these existing FPM-based techniques are predominantly confined to rudimentary strategies of either augmenting the foreground or diminishing the background presence. We argue for the exploration and exploitation of the intricate interplay between the object's foreground and its background to achieve efficient object localization. In this manuscript, we introduce an innovative framework, termed adaptive zone learning (AZL), which operates on a coarse-to-fine basis to refine FPMs through a triad of adaptive zone mechanisms. First, an adversarial learning mechanism (ALM) is employed, orchestrating an interplay between the foreground and background regions. This mechanism accentuates coarse-grained object regions in a mutually adversarial manner. Subsequently, an oriented learning mechanism (OLM) is unveiled, which harnesses local insights from both foreground and background in a fine-grained manner. This mechanism is instrumental in delineating object regions with greater granularity, thereby generating better FPMs. Furthermore, we propose a reinforced learning mechanism (RLM) as the compensatory mechanism for adversarial design, by which the undesirable foreground maps are refined again. Extensive experiments on CUB-200-2011 and ILSVRC datasets demonstrate that AZL achieves significant and consistent performance improvements over other state-of-the-art WSOL methods.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Adaptive attention augmentor for weakly supervised object localization
    Zhang, Longhao
    Yang, Huihua
    [J]. NEUROCOMPUTING, 2021, 454 : 474 - 482
  • [2] Weakly Supervised Object Localization with Latent Category Learning
    Wang, Chong
    Ren, Weiqiang
    Huang, Kaiqi
    Tan, Tieniu
    [J]. COMPUTER VISION - ECCV 2014, PT VI, 2014, 8694 : 431 - 445
  • [3] Feature disparity learning for weakly supervised object localization
    Li, Bingfeng
    Ruan, Haohao
    Li, Xinwei
    Wang, Keping
    [J]. IMAGE AND VISION COMPUTING, 2024, 145
  • [4] Strengthen Learning Tolerance for Weakly Supervised Object Localization
    Guo, Guangyu
    Han, Junwei
    Wan, Fang
    Zhang, Dingwen
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 7399 - 7408
  • [5] Hierarchical complementary learning for weakly supervised object localization
    Benassou, Sabrina Narimene
    Shi, Wuzhen
    Jiang, Feng
    Benzine, Abdallah
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2022, 100
  • [6] Adversarial Complementary Learning for Weakly Supervised Object Localization
    Zhang, Xiaolin
    Wei, Yunchao
    Feng, Jiashi
    Yang, Yi
    Huang, Thomas
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 1325 - 1334
  • [7] Two-Phase Learning for Weakly Supervised Object Localization
    Kim, Dahun
    Cho, Donghyeon
    Yoo, Donggeun
    Kweon, In So
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 3554 - 3563
  • [8] Weakly Supervised Learning for Object Localization Based on an Attention Mechanism
    Park, Nojin
    Ko, Hanseok
    [J]. APPLIED SCIENCES-BASEL, 2021, 11 (22):
  • [9] Rethinking the Localization in Weakly Supervised Object Localization
    Xu, Rui
    Luo, Yong
    Hu, Han
    Du, Bo
    Shen, Jialie
    Wen, Yonggang
    [J]. PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 5484 - 5494
  • [10] Generalized Weakly Supervised Object Localization
    Zhang, Dingwen
    Guo, Guangyu
    Zeng, Wenyuan
    Li, Lei
    Han, Junwei
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (04) : 5395 - 5406