Dendritic Learning-Incorporated Vision Transformer for Image Recognition

被引:7
|
作者
Zhang, Zhiming [1 ]
Lei, Zhenyu [1 ]
Omura, Masaaki [1 ]
Hasegawa, Hideyuki [1 ]
Gao, Shangce [1 ]
机构
[1] Univ Toyama, Fac Engn, Toyama 9308555, Japan
基金
日本学术振兴会; 日本科学技术振兴机构;
关键词
D O I
10.1109/JAS.2023.123978
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This letter proposes to integrate dendritic learnable network architecture with Vision Transformer to improve the accuracy of image recognition. In this study, based on the theory of dendritic neurons in neuroscience, we design a network that is more practical for engineering to classify visual features. Based on this, we propose a dendritic learning-incorporated vision Transformer (DVT), which out-performs other state-of-the-art methods on three image recognition benchmarks.
引用
收藏
页码:539 / 541
页数:3
相关论文
共 50 条
  • [11] Task-Agnostic Vision Transformer for Distributed Learning of Image Processing
    Kim, Boah
    Kim, Jeongsol
    Ye, Jong Chul
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 203 - 218
  • [12] Vision Transformer With Contrastive Learning for Remote Sensing Image Scene Classification
    Bi, Meiqiao
    Wang, Minghua
    Li, Zhi
    Hong, Danfeng
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 738 - 749
  • [13] CRViT: Vision transformer advanced by causality and inductive bias for image recognition: CRViT: Vision transformer advanced by causality and inductive bias for image recognition: F. Lu et al.
    Lu, Faming
    Jia, Kunhao
    Zhang, Xue
    Sun, Lin
    [J]. Applied Intelligence, 2025, 55 (01)
  • [14] Mask usage recognition using vision transformer with transfer learning and data augmentation
    Jahja, Hensel D.
    Yudistira, Novanto
    Sutrisno
    [J]. INTELLIGENT SYSTEMS WITH APPLICATIONS, 2023, 17
  • [15] Vision Transformer and Deep Sequence Learning for Human Activity Recognition in Surveillance Videos
    Hussain, Altaf
    Hussain, Tanveer
    Ullah, Waseem
    Baik, Sung Wook
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [16] CONTINUAL LEARNING IN VISION TRANSFORMER
    Takeda, Mana
    Yanai, Keiji
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 616 - 620
  • [17] Token Adaptive Vision Transformer with Efficient Deployment for Fine-Grained Image Recognition
    Lee, Chonghan
    Brufau, Rita Brugarolas
    Ding, Ke
    Narayanan, Vijaykrishnan
    [J]. 2023 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION, DATE, 2023,
  • [18] Recognition of penetration state in GTAW based on vision transformer using weld pool image
    Zhenmin Wang
    Haoyu Chen
    Qiming Zhong
    Sanbao Lin
    Jianwen Wu
    Mengjia Xu
    Qin Zhang
    [J]. The International Journal of Advanced Manufacturing Technology, 2022, 119 : 5439 - 5452
  • [19] Recognition of penetration state in GTAW based on vision transformer using weld pool image
    Wang, Zhenmin
    Chen, Haoyu
    Zhong, Qiming
    Lin, Sanbao
    Wu, Jianwen
    Xu, Mengjia
    Zhang, Qin
    [J]. INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2022, 119 (7-8): : 5439 - 5452
  • [20] Analysis of Blood Cell Image Recognition Methods Based on Improved CNN and Vision Transformer
    Wang, Pingping
    Zhang, Xinyi
    Zhao, Yuyan
    Li, Yueti
    Xu, Kaisheng
    Zhao, Shuaiyin
    [J]. IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2024, E107A (06) : 899 - 908