Image Classification based on Self-attention Convolutional Neural Network

被引:0
|
作者
Cai, Xiaohong [1 ]
Li, Ming [1 ]
Cao, Hui [1 ]
Ma, Jingang [1 ]
Wang, Xiaoyan [1 ]
Zhuang, Xuqiang [2 ]
机构
[1] Shandong Univ Tradit Chinese Med, Sch Intelligence & Informat Engn, Jinan 250355, Peoples R China
[2] Shandong Normal Univ, Sch Informat Sci & Engn, Jinan 250358, Peoples R China
关键词
Image Classification; Self Attention; Convolutional Neural Networks;
D O I
10.1117/12.2604788
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Image classification technology is the most basic and important technical branch of computer vision. How to effectively extract effective information from images has become more and more urgent. First, we use the self-attention module to use the correlation between the features to weight and sum the features to get the image category. The self-attention mechanism is simpler to calculate, which greatly reduces the complexity of the model. Secondly, we have also made an optimization strategy for the complex CNN (Convolutional Neural Network) model. This article uses the global average pooling method to replace the fully connected method, which reduces the complexity of the model and generates fewer features. Finally, we verified the feasibility and effectiveness of our model on two data sets.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Self-attention convolutional neural network for improved MR image reconstruction
    Wu, Yan
    Ma, Yajun
    Liu, Jing
    Du, Jiang
    Xing, Lei
    [J]. INFORMATION SCIENCES, 2019, 490 : 317 - 328
  • [2] A Visual Attention Based Convolutional Neural Network for Image Classification
    Chen, Yaran
    Zhao, Dongbin
    Lv, Le
    Li, Chengdong
    [J]. PROCEEDINGS OF THE 2016 12TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), 2016, : 764 - 769
  • [3] Crop leaf disease recognition based on Self-Attention convolutional neural network
    Zeng, Weihui
    Li, Miao
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2020, 172
  • [4] Deep Pyramid Convolutional Neural Network Integrated with Self-attention Mechanism and Highway Network for Text Classification
    Li, Xuewei
    Ning, Hongyun
    [J]. 4TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE APPLICATIONS AND TECHNOLOGIES (AIAAT 2020), 2020, 1642
  • [5] Hyperspectral Image Classification Based on Dilated Convolutional Attention Neural Network
    Zhang Xiangdong
    Wang Tengjun
    Zhu Shaojun
    Yang Yun
    [J]. ACTA OPTICA SINICA, 2021, 41 (03)
  • [6] A self-attention multi-scale convolutional neural network method for SAR image despeckling
    Wen, Zhiqing
    He, Yi
    Yao, Sheng
    Yang, Wang
    Zhang, Lifeng
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (03) : 902 - 923
  • [7] SAFSN: A Self-Attention Based Neural Network for Encrypted Mobile Traffic Classification
    Zhang, Chengyuan
    An, Changqing
    Wang, Jessie Hui
    Zhao, Ziyi
    Yu, Tao
    Wang, Jilong
    [J]. IEEE CONGRESS ON CYBERMATICS / 2021 IEEE INTERNATIONAL CONFERENCES ON INTERNET OF THINGS (ITHINGS) / IEEE GREEN COMPUTING AND COMMUNICATIONS (GREENCOM) / IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING (CPSCOM) / IEEE SMART DATA (SMARTDATA), 2021, : 330 - 337
  • [8] Global Convolutional Neural Networks With Self-Attention for Fisheye Image Rectification
    Kim, Byunghyun
    Lee, Dohyun
    Min, Kyeongyuk
    Chong, Jongwha
    Joe, Inwhee
    [J]. IEEE ACCESS, 2022, 10 : 129580 - 129587
  • [9] Self-attention convolutional neural network based fault diagnosis algorithm for chemical process
    Ren Jia
    Zou Hongrui
    Tang Lijuan
    Sun Siyu
    Shen Qihao
    Wang Xiang
    Bao Ke
    [J]. 2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 4046 - 4051
  • [10] Biscale Convolutional Self-Attention Network for Hyperspectral Coastal Wetlands Classification
    Luo, Junshen
    He, Zhi
    Lin, Haomei
    Wu, Heqian
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5