Multispectral Plant Disease Detection with Vision Transformer-Convolutional Neural Network Hybrid Approaches

被引:2
|
作者
De Silva, Malithi [1 ]
Brown, Dane [1 ]
机构
[1] Rhodes Univ, Dept Comp Sci, Hamilton Bldg,Prince Alfred St, ZA-6139 Grahamstown, South Africa
关键词
plant disease identification; deep-learning; CNN; ViT; multispectral images; NIR; CNN;
D O I
10.3390/s23208531
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Plant diseases pose a critical threat to global agricultural productivity, demanding timely detection for effective crop yield management. Traditional methods for disease identification are laborious and require specialised expertise. Leveraging cutting-edge deep learning algorithms, this study explores innovative approaches to plant disease identification, combining Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) to enhance accuracy. A multispectral dataset was meticulously collected to facilitate this research using six 50 mm filter filters, covering both the visible and several near-infrared (NIR) wavelengths. Among the models employed, ViT-B16 notably achieved the highest test accuracy, precision, recall, and F1 score across all filters, with averages of 83.3%, 90.1%, 90.75%, and 89.5%, respectively. Furthermore, a comparative analysis highlights the pivotal role of balanced datasets in selecting the appropriate wavelength and deep learning model for robust disease identification. These findings promise to advance crop disease management in real-world agricultural applications and contribute to global food security. The study underscores the significance of machine learning in transforming plant disease diagnostics and encourages further research in this field.
引用
收藏
页数:22
相关论文
共 50 条
  • [1] Efficient knowledge distillation for hybrid models: A vision transformer-convolutional neural network to convolutional neural network approach for classifying remote sensing images
    Song, Huaxiang
    Yuan, Yuxuan
    Ouyang, Zhiwei
    Yang, Yu
    Xiang, Hui
    [J]. IET CYBER-SYSTEMS AND ROBOTICS, 2024, 6 (03)
  • [2] Vision transformer meets convolutional neural network for plant disease classification
    Thakur, Poornima Singh
    Chaturvedi, Shubhangi
    Khanna, Pritee
    Sheorey, Tanuja
    Ojha, Aparajita
    [J]. ECOLOGICAL INFORMATICS, 2023, 77
  • [3] Attention-guided hybrid transformer-convolutional neural network for underwater image super-resolution
    Zhan, Zihan
    Li, Chaofeng
    Zhang, Yuqi
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (01)
  • [4] Using a Hybrid Convolutional Neural Network with a Transformer Model for Tomato Leaf Disease Detection
    Chen, Zhichao
    Wang, Guoqiang
    Lv, Tao
    Zhang, Xu
    [J]. AGRONOMY-BASEL, 2024, 14 (04):
  • [5] Single-image super-resolution using lightweight transformer-convolutional neural network hybrid model
    Liu, Yuanyuan
    Yue, Mengtao
    Yan, Han
    Zhu, Lu
    [J]. IET IMAGE PROCESSING, 2023, 17 (10) : 2881 - 2893
  • [6] Plant disease detection using hybrid model based on convolutional autoencoder and convolutional neural network
    Bedi, Punam
    Gole, Pushkar
    [J]. ARTIFICIAL INTELLIGENCE IN AGRICULTURE, 2021, 5 (05): : 90 - 101
  • [7] ETCNN: An ensemble transformer-convolutional neural network for automatic analysis of fetal heart rate
    Wu, Qingjian
    Lu, Yaosheng
    Kang, Xue
    Wang, Huijin
    Zheng, Zheng
    Bai, Jieyun
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 96
  • [8] Hybrid network of convolutional neural network and transformer for deepfake geographic image detection
    Liu, Xiaoyong
    Dong, Xiaofei
    Xie, Feng
    Lu, Pei
    Lu, Xi
    Jiang, Mingzhong
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (02)
  • [9] CoTCoNet: An optimized coupled transformer-convolutional network with an adaptive graph reconstruction for leukemia detection
    Raghaw, Chandravardhan Singh
    Sharma, Arnav
    Bansal, Shubhi
    Rehman, Mohammad Zia Ur
    Kumar, Nagendra
    [J]. Computers in Biology and Medicine, 2024, 179
  • [10] TCURL: Exploring hybrid transformer and convolutional neural network on phishing URL detection
    Wang, Chenguang
    Chen, Yuanyuan
    [J]. KNOWLEDGE-BASED SYSTEMS, 2022, 258