A Hybrid Lightweight Deep Neural Network Approach for Plant Disease Classification Using Self-Attention Mechanism and Transfer Learning

被引:0
|
作者
Alramli, Thaer Sultan Darweesh [1 ,2 ]
Tekerek, Adem [3 ]
机构
[1] Gazi Univ, Grad Sch Nat & Appl Sci, TR-06570 Ankara, Turkiye
[2] Univ Mosul, Comp Engn Dept, Mosul 41002, Iraq
[3] Gazi Univ, Fac Technol, Comp Engn Dept, TR-06570 Ankara, Turkiye
关键词
Leaf classification; Convolutional neural network; Efficient Neural Network; Squeeze and Excitation Network; Classification accuracy; RECOGNITION METHOD;
D O I
10.15832/ankutbd.1537267
中图分类号
S [农业科学];
学科分类号
09 ;
摘要
Classification of plant diseases is crucial for overall food security and agricultural economies in the world. However, classification has long been challenging primarily due to the various diseases it encompasses and the different environmental factors influencing them. One of the main challenges in developing an accurate classification model is obtaining high-quality, multiclass datasets. At the same time, deep learning methods like CNN may be considered state-of-the-art in detecting complex image patterns in various applications for correct diagnoses. Still, they involve poor parameter optimizations and overfitting and have very high resource requirements. This paper introduces a combined model of classifying plant diseases in an imaging approach, which incorporates the Efficient Neural Network (ENN) with a Squeeze and Excitation Network (SEN). The architecture follows high-density feature extraction by the networks, late fusion of features, and using a cross-channel attention mechanism to boost feature representation. This work uses transfer learning to design the hyperparameter optimization scheme and early stopping scheme to avoid overfitting. We tested our model on the Plant Village Dataset and the Leaf Rose Disease Dataset with an accuracy of 96.40% for the Plant Village Dataset and 97.15% accuracy on the Leaf Rose Disease Dataset. Our model achieved higher accuracy than the traditional DNNs VGG16, Inception V3, and RESNET-50 by approximately 21.04%, 9.40%, and 4.33% on the Plant Village Dataset. It improved the classification accuracy compared to VGG16, Inception V3, and RESNET-50 by 15.80%, 11.20%, and 6.02% on the Rose leaf disease dataset, respectively. Moreover, it has the lowest times as well as space complexity: 45 minutes and 150 MB, which are less than VGG16 (50 minutes, 180 MB), Inception Net (55 minutes, 170 MB), and RESNET50 (75 minutes, 190 MB). The global results show that our approach is superior, demonstrating enhanced performance and efficiency, which makes it well-suited for real-time applications.
引用
收藏
页码:392 / 412
页数:21
相关论文
共 50 条
  • [31] Self-attention based GRU neural network for deep knowledge tracing
    Jin, Shangzhu
    Zhao, Yan
    Peng, Jun
    Chen, Ning
    Xue, Run
    Liang, Minghui
    Jiang, Yunfeng
    2022 IEEE 17TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA), 2022, : 1436 - 1440
  • [32] A Deep Learning Approach for Classifying Vulnerability Descriptions Using Self Attention Based Neural Network
    P. R. Vishnu
    P. Vinod
    Suleiman Y. Yerima
    Journal of Network and Systems Management, 2022, 30
  • [33] A Deep Learning Approach for Classifying Vulnerability Descriptions Using Self Attention Based Neural Network
    Vishnu, P. R.
    Vinod, P.
    Yerima, Suleiman Y.
    JOURNAL OF NETWORK AND SYSTEMS MANAGEMENT, 2022, 30 (01)
  • [34] Research on a Capsule Network Text Classification Method with a Self-Attention Mechanism
    Yu, Xiaodong
    Luo, Shun-Nain
    Wu, Yujia
    Cai, Zhufei
    Kuan, Ta-Wen
    Tseng, Shih-Pang
    SYMMETRY-BASEL, 2024, 16 (05):
  • [35] Identifying plant diseases using deep transfer learning and enhanced lightweight network
    Junde Chen
    Defu Zhang
    Y. A. Nanehkaran
    Multimedia Tools and Applications, 2020, 79 : 31497 - 31515
  • [36] Identifying plant diseases using deep transfer learning and enhanced lightweight network
    Chen, Junde
    Zhang, Defu
    Nanehkaran, Y. A.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (41-42) : 31497 - 31515
  • [37] Siamese Recurrent Neural Network with a Self-Attention Mechanism for Bioactivity Prediction
    Fernandez-Llaneza, Daniel
    Ulander, Silas
    Gogishvili, Dea
    Nittinger, Eva
    Zhao, Hongtao
    Tyrchan, Christian
    ACS OMEGA, 2021, 6 (16): : 11086 - 11094
  • [38] Analysis of transfer learning for deep neural network based plant classification models
    Kaya, Aydin
    Keceli, Ali Seydi
    Catal, Cagatay
    Yalic, Hamdi Yalin
    Temucin, Huseyin
    Tekinerdogan, Bedir
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2019, 158 : 20 - 29
  • [39] Neural Named Entity Recognition Using a Self-Attention Mechanism
    Zukov-Gregoric, Andrej
    Bachrach, Yoram
    Minkovsky, Pasha
    Coope, Sam
    Maksak, Bogdan
    2017 IEEE 29TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE (ICTAI 2017), 2017, : 652 - 656
  • [40] Deep & Attention : A Self-Attention based Neural Network for Remaining Useful Lifetime Predictions
    Li, Yuanjun
    Wang, Xingang
    2021 7TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND ROBOTICS ENGINEERING (ICMRE 2021), 2021, : 98 - 105