A Hybrid Lightweight Deep Neural Network Approach for Plant Disease Classification Using Self-Attention Mechanism and Transfer Learning

被引:0
|
作者
Alramli, Thaer Sultan Darweesh [1 ,2 ]
Tekerek, Adem [3 ]
机构
[1] Gazi Univ, Grad Sch Nat & Appl Sci, TR-06570 Ankara, Turkiye
[2] Univ Mosul, Comp Engn Dept, Mosul 41002, Iraq
[3] Gazi Univ, Fac Technol, Comp Engn Dept, TR-06570 Ankara, Turkiye
关键词
Leaf classification; Convolutional neural network; Efficient Neural Network; Squeeze and Excitation Network; Classification accuracy; RECOGNITION METHOD;
D O I
10.15832/ankutbd.1537267
中图分类号
S [农业科学];
学科分类号
09 ;
摘要
Classification of plant diseases is crucial for overall food security and agricultural economies in the world. However, classification has long been challenging primarily due to the various diseases it encompasses and the different environmental factors influencing them. One of the main challenges in developing an accurate classification model is obtaining high-quality, multiclass datasets. At the same time, deep learning methods like CNN may be considered state-of-the-art in detecting complex image patterns in various applications for correct diagnoses. Still, they involve poor parameter optimizations and overfitting and have very high resource requirements. This paper introduces a combined model of classifying plant diseases in an imaging approach, which incorporates the Efficient Neural Network (ENN) with a Squeeze and Excitation Network (SEN). The architecture follows high-density feature extraction by the networks, late fusion of features, and using a cross-channel attention mechanism to boost feature representation. This work uses transfer learning to design the hyperparameter optimization scheme and early stopping scheme to avoid overfitting. We tested our model on the Plant Village Dataset and the Leaf Rose Disease Dataset with an accuracy of 96.40% for the Plant Village Dataset and 97.15% accuracy on the Leaf Rose Disease Dataset. Our model achieved higher accuracy than the traditional DNNs VGG16, Inception V3, and RESNET-50 by approximately 21.04%, 9.40%, and 4.33% on the Plant Village Dataset. It improved the classification accuracy compared to VGG16, Inception V3, and RESNET-50 by 15.80%, 11.20%, and 6.02% on the Rose leaf disease dataset, respectively. Moreover, it has the lowest times as well as space complexity: 45 minutes and 150 MB, which are less than VGG16 (50 minutes, 180 MB), Inception Net (55 minutes, 170 MB), and RESNET50 (75 minutes, 190 MB). The global results show that our approach is superior, demonstrating enhanced performance and efficiency, which makes it well-suited for real-time applications.
引用
收藏
页码:392 / 412
页数:21
相关论文
共 50 条
  • [21] Deep Clustering Efficient Learning Network for Motion Recognition Based on Self-Attention Mechanism
    Ru, Tielin
    Zhu, Ziheng
    APPLIED SCIENCES-BASEL, 2023, 13 (05):
  • [22] DeepCAC: a deep learning approach on DNA transcription factors classification based on multi-head self-attention and concatenate convolutional neural network
    Zhang, Jidong
    Liu, Bo
    Wu, Jiahui
    Wang, Zhihan
    Li, Jianqiang
    BMC BIOINFORMATICS, 2023, 24 (01)
  • [23] Remote Sensing Image Classification using Transfer Learning and Attention Based Deep Neural Network
    Pham, Lam
    Tran, Khoa
    Ngo, Dat
    Lampert, Jasmin
    Schindler, Alexander
    IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING XXVIII, 2022, 12267
  • [24] DeepCAC: a deep learning approach on DNA transcription factors classification based on multi-head self-attention and concatenate convolutional neural network
    Jidong Zhang
    Bo Liu
    Jiahui Wu
    Zhihan Wang
    Jianqiang Li
    BMC Bioinformatics, 24
  • [25] DCCL: Dual-channel hybrid neural network combined with self-attention for text classification
    Li, Chaofan
    Qiong, Liu
    Kai, Ma
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (02) : 1981 - 1992
  • [26] EEG Classification Using Hybrid Convolutional Neural Network with Attention Mechanism
    Ciurea, Alexe
    Manoila, Cristina-Petruta
    Ionescu, Bogdan
    ADVANCES IN DIGITAL HEALTH AND MEDICAL BIOENGINEERING, VOL 1, EHB-2023, 2024, 109 : 783 - 791
  • [27] Plant leaf disease classification using deep Convolutional neural network with Bayesian learning
    Sachdeva, Guneet
    Singh, Preeti
    Kaur, Pardeep
    MATERIALS TODAY-PROCEEDINGS, 2021, 45 : 5584 - 5590
  • [28] Automatic Food Recognition Using Deep Convolutional Neural Networks with Self-attention Mechanism
    Rahib Abiyev
    Joseph Adepoju
    Human-Centric Intelligent Systems, 2024, 4 (1): : 171 - 186
  • [29] Industrial-Mass Mini/Micro LED Sorting Using Patch Enhanced Lightweight Self-Attention Hybrid Neural Network
    Chu, Jie
    Cai, Jueping
    Hou, Biao
    Wen, Kailin
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2025, 21 (01) : 723 - 732
  • [30] Improving Deep Learning-based Plant Disease Classification with Attention Mechanism
    Alirezazadeh, Pendar
    Schirrmann, Michael
    Stolzenburg, Frieder
    GESUNDE PFLANZEN, 2023, 75 (01): : 49 - 59