A Hybrid Lightweight Deep Neural Network Approach for Plant Disease Classification Using Self-Attention Mechanism and Transfer Learning

被引:0
|
作者
Alramli, Thaer Sultan Darweesh [1 ,2 ]
Tekerek, Adem [3 ]
机构
[1] Gazi Univ, Grad Sch Nat & Appl Sci, TR-06570 Ankara, Turkiye
[2] Univ Mosul, Comp Engn Dept, Mosul 41002, Iraq
[3] Gazi Univ, Fac Technol, Comp Engn Dept, TR-06570 Ankara, Turkiye
关键词
Leaf classification; Convolutional neural network; Efficient Neural Network; Squeeze and Excitation Network; Classification accuracy; RECOGNITION METHOD;
D O I
10.15832/ankutbd.1537267
中图分类号
S [农业科学];
学科分类号
09 ;
摘要
Classification of plant diseases is crucial for overall food security and agricultural economies in the world. However, classification has long been challenging primarily due to the various diseases it encompasses and the different environmental factors influencing them. One of the main challenges in developing an accurate classification model is obtaining high-quality, multiclass datasets. At the same time, deep learning methods like CNN may be considered state-of-the-art in detecting complex image patterns in various applications for correct diagnoses. Still, they involve poor parameter optimizations and overfitting and have very high resource requirements. This paper introduces a combined model of classifying plant diseases in an imaging approach, which incorporates the Efficient Neural Network (ENN) with a Squeeze and Excitation Network (SEN). The architecture follows high-density feature extraction by the networks, late fusion of features, and using a cross-channel attention mechanism to boost feature representation. This work uses transfer learning to design the hyperparameter optimization scheme and early stopping scheme to avoid overfitting. We tested our model on the Plant Village Dataset and the Leaf Rose Disease Dataset with an accuracy of 96.40% for the Plant Village Dataset and 97.15% accuracy on the Leaf Rose Disease Dataset. Our model achieved higher accuracy than the traditional DNNs VGG16, Inception V3, and RESNET-50 by approximately 21.04%, 9.40%, and 4.33% on the Plant Village Dataset. It improved the classification accuracy compared to VGG16, Inception V3, and RESNET-50 by 15.80%, 11.20%, and 6.02% on the Rose leaf disease dataset, respectively. Moreover, it has the lowest times as well as space complexity: 45 minutes and 150 MB, which are less than VGG16 (50 minutes, 180 MB), Inception Net (55 minutes, 170 MB), and RESNET50 (75 minutes, 190 MB). The global results show that our approach is superior, demonstrating enhanced performance and efficiency, which makes it well-suited for real-time applications.
引用
收藏
页码:392 / 412
页数:21
相关论文
共 50 条
  • [1] A Dynamic Self-Attention Mechanism for Improving Deep Learning-based Plant Disease Classification
    Akella, Gopi Krishna
    Wibowo, Santoso
    Grandhi, Srimannarayana
    Sabrina, Fariza
    Mubarak, Sameera
    27TH IEEE/ACIS INTERNATIONAL SUMMER CONFERENCE ON SOFTWARE ENGINEERING ARTIFICIAL INTELLIGENCE NETWORKING AND PARALLEL/DISTRIBUTED COMPUTING, SNPD 2024-SUMMER, 2024, : 222 - 227
  • [2] Bearing fault diagnosis using transfer learning and self-attention ensemble lightweight convolutional neural network
    Zhong, Hongyu
    Lv, Yong
    Yuan, Rui
    Yang, Di
    NEUROCOMPUTING, 2022, 501 : 765 - 777
  • [3] FCN-Attention: A deep learning UWB NLOS/LOS classification algorithm using fully convolution neural network with self-attention mechanism
    Pei, Yu
    Chen, Ruizhi
    Li, Deren
    Xiao, Xiongwu
    Zheng, Xingyu
    GEO-SPATIAL INFORMATION SCIENCE, 2024, 27 (04): : 1162 - 1181
  • [4] Missing well logs prediction using deep learning integrated neural network with the self-attention mechanism
    Wang, Jun
    Cao, Junxing
    Fu, Jingcheng
    Xu, Hanqing
    ENERGY, 2022, 261
  • [5] Deep Learning Approach to Impact Classification in Sensorized Panels Using Self-Attention
    Karmakov, Stefan
    Aliabadi, M. H. Ferri
    SENSORS, 2022, 22 (12)
  • [6] Deep Pyramid Convolutional Neural Network Integrated with Self-attention Mechanism and Highway Network for Text Classification
    Li, Xuewei
    Ning, Hongyun
    4TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE APPLICATIONS AND TECHNOLOGIES (AIAAT 2020), 2020, 1642
  • [7] Lightweight Self-Attention Residual Network for Hyperspectral Classification
    Xia, Jinbiao
    Cui, Ying
    Li, Wenshan
    Wang, Liguo
    Wang, Chao
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [8] Neural network based on convolution and self-attention fusion mechanism for plant leaves disease recognition
    Zhao, Yun
    Li, Yang
    Wu, Na
    Xu, Xing
    CROP PROTECTION, 2024, 180
  • [9] A Deep Neural Network Using Double Self-Attention Mechanism for ALS Point Cloud Segmentation
    Yu, Lili
    Yu, Haiyang
    Yang, Shuai
    IEEE ACCESS, 2022, 10 : 29878 - 29889
  • [10] A hybrid self-attention deep learning framework for multivariate sleep stage classification
    Yuan, Ye
    Jia, Kebin
    Ma, Fenglong
    Xun, Guangxu
    Wang, Yaqing
    Su, Lu
    Zhang, Aidong
    BMC BIOINFORMATICS, 2019, 20 (Suppl 16)