Module of Axis-based Nexus Attention for weakly supervised object localization

被引:0
|
作者
Junghyo Sohn
Eunjin Jeon
Wonsik Jung
Eunsong Kang
Heung-Il Suk
机构
[1] Korea University,Department of Artificial Intelligence
[2] Korea University,Department of Brain and Cognitive Engineering
来源
关键词
D O I
暂无
中图分类号
学科分类号
摘要
Weakly supervised object localization tasks remain challenging to identify and segment an entire object rather than only discriminative parts of the object. To tackle this problem, corruption-based approaches have been devised, which involve the training of non-discriminative regions by corrupting (e.g., erasing) the input images or intermediate feature maps. However, this approach requires an additional hyperparameter, the corrupting threshold, to determine the degree of corruption and can unfavorably disrupt training. It also tends to localize object regions coarsely. In this paper, we propose a novel approach, Module of Axis-based Nexus Attention (MoANA), which helps to adaptively activate less discriminative regions along with the class-discriminative regions without an additional hyperparameter, and elaborately localizes an entire object. Specifically, MoANA consists of three mechanisms (1) triple-view attentions representation, (2) attentions expansion, and (3) features calibration mechanism. Unlike other attention-based methods that train a coarse attention map with the same values across elements in feature maps, MoANA trains fine-grained values in an attention map by assigning different attention values to each element. We validated MoANA by comparing it with various methods. We also analyzed the effect of each component in MoANA and visualized attention maps to provide insights into the calibration.
引用
收藏
相关论文
共 50 条
  • [1] Module of Axis-based Nexus Attention for weakly supervised object localization
    Sohn, Junghyo
    Jeon, Eunjin
    Jung, Wonsik
    Kang, Eunsong
    Suk, Heung-Il
    [J]. SCIENTIFIC REPORTS, 2023, 13 (01)
  • [2] Dual-attention Guided Dropblock Module for Weakly Supervised Object Localization
    Yin, Junhui
    Zhang, Siqing
    Chang, Dongliang
    Ma, Zhanyu
    Guo, Jun
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 4229 - 4236
  • [3] Weakly Supervised Learning for Object Localization Based on an Attention Mechanism
    Park, Nojin
    Ko, Hanseok
    [J]. APPLIED SCIENCES-BASEL, 2021, 11 (22):
  • [4] Attention-based Selection Strategy for Weakly Supervised Object Localization
    Zhang, Zhenfei
    Bui, Tien D.
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 10305 - 10311
  • [5] Attention-based Dropout Layer for Weakly Supervised Object Localization
    Choe, Junsuk
    Shim, Hyunjung
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 2214 - 2223
  • [6] Weakly Supervised Object Localization Based on Attention Mechanism and Categorical Hierarchy
    Feng X.
    Yang J.
    Zhou T.
    Gong C.
    [J]. Ruan Jian Xue Bao/Journal of Software, 2023, 34 (10): : 4916 - 4929
  • [7] Adaptive attention augmentor for weakly supervised object localization
    Zhang, Longhao
    Yang, Huihua
    [J]. NEUROCOMPUTING, 2021, 454 : 474 - 482
  • [8] Aggregation of attention and erasing for weakly supervised object localization
    Koo, Bongyeong
    Choi, Han-Soo
    Kang, Myungjoo
    [J]. IMAGE AND VISION COMPUTING, 2023, 129
  • [9] Region-based dropout with attention prior for weakly supervised object localization
    Choe, Junsuk
    Han, Dongyoon
    Yun, Sangdoo
    Ha, Jung-Woo
    Oh, Seong Joon
    Shim, Hyunjung
    [J]. PATTERN RECOGNITION, 2021, 116
  • [10] RSMNet: A Regional Similar Module Network for Weakly Supervised Object Localization
    Zhigang Ling
    Liang Li
    Aoran Zhang
    [J]. Neural Processing Letters, 2022, 54 : 5079 - 5097