Two-Level Attentions and Grouping Attention Convolutional Network for Fine-Grained Image Classification

被引:13
|
作者
Yang, Yadong [1 ]
Wang, Xiaofeng [1 ]
Zhao, Quan [1 ]
Sui, Tingting [2 ]
机构
[1] Shanghai Maritime Univ, Coll Informat Engn, Shanghai 201306, Peoples R China
[2] Shanghai Dianji Univ, Sch Elect Informat Engn, Shanghai 201306, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2019年 / 9卷 / 09期
基金
中国国家自然科学基金;
关键词
fine-grained image classification; visual attention mechanism; two-level attention model; grouping attention model; multi-level feature fusion;
D O I
10.3390/app9091939
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The focus of fine-grained image classification tasks is to ignore interference information and grasp local features. This challenge is what the visual attention mechanism excels at. Firstly, we have constructed a two-level attention convolutional network, which characterizes the object-level attention and the pixel-level attention. Then, we combine the two kinds of attention through a second-order response transform algorithm. Furthermore, we propose a clustering-based grouping attention model, which implies the part-level attention. The grouping attention method is to stretch all the semantic features, in a deeper convolution layer of the network, into vectors. These vectors are clustered by a vector dot product, and each category represents a special semantic. The grouping attention algorithm implements the functions of group convolution and feature clustering, which can greatly reduce the network parameters and improve the recognition rate and interpretability of the network. Finally, the low-level visual features and high-level semantic information are merged by a multi-level feature fusion method to accurately classify fine-grained images. We have achieved good results without using pre-training networks and fine-tuning techniques.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Two-Level Progressive Attention Convolutional Network for Fine-Grained Image Recognition
    Wei, Hua
    Zhu, Ming
    Wang, Bo
    Wang, Jiarong
    Sun, Deyao
    [J]. IEEE ACCESS, 2020, 8 : 104985 - 104995
  • [2] The Application of Two-level Attention Models in Deep Convolutional Neural Network for Fine-grained Image Classification
    Xiao, Tianjun
    Xu, Yichong
    Yang, Kuiyuan
    Zhang, Jiaxing
    Peng, Yuxin
    Zhang, Zheng
    [J]. 2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, : 842 - 850
  • [3] Learning Two-level Features for Fine-grained Image Classification
    Ji, Jinsheng
    Jiang, Linfeng
    Lei, Chenxi
    Zhong, Weilin
    Xiong, Huilin
    [J]. PROCEEDINGS OF 2018 14TH IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP), 2018, : 544 - 549
  • [4] Weakly supervised fine-grained image classification via two-level attention activation model
    Ke, Xiao
    Huang, Yanyan
    Guo, WenZhong
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2022, 218
  • [5] Convolutional Attention Network with Maximizing Mutual Information for Fine-Grained Image Classification
    Wang, Fenglei
    Zhou, Hao
    Li, Shuohao
    Lei, Jun
    Zhang, Jun
    [J]. SYMMETRY-BASEL, 2020, 12 (09):
  • [6] Subtler mixed attention network on fine-grained image classification
    Liu, Chao
    Huang, Lei
    Wei, Zhiqiang
    Zhang, Wenfeng
    [J]. APPLIED INTELLIGENCE, 2021, 51 (11) : 7903 - 7916
  • [7] Subtler mixed attention network on fine-grained image classification
    Chao Liu
    Lei Huang
    Zhiqiang Wei
    Wenfeng Zhang
    [J]. Applied Intelligence, 2021, 51 : 7903 - 7916
  • [8] Grouping Bilinear Pooling for Fine-Grained Image Classification
    Zeng, Rui
    He, Jingsong
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (10):
  • [9] Smoking behavior recognition based on a two-level attention fine-grained model and EfficientDet network
    Li, Fanshu
    Yao, Dengfeng
    Jiang, Minghu
    Kang, Xinchen
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 43 (05) : 5733 - 5747
  • [10] A Fine-Grained Image Classification and Detection Method Based on Convolutional Neural Network Fused with Attention Mechanism
    Zhang, Yue
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022