Evaluation of Deep Learning Segmentation Models for Detection of Pine Wilt Disease in Unmanned Aerial Vehicle Images

被引:45
|
作者
Xia, Lang [1 ,2 ]
Zhang, Ruirui [1 ,2 ]
Chen, Liping [3 ,4 ]
Li, Longlong [3 ,4 ]
Yi, Tongchuan [3 ,4 ]
Wen, Yao [1 ,2 ]
Ding, Chenchen [1 ,2 ]
Xie, Chunchun [5 ]
机构
[1] Natl Res Ctr Intelligent Equipment Agr, Beijing Acad Agr & Forestry Sci, Beijing 100097, Peoples R China
[2] Beijing Acad Agr & Forestry Sci, Beijing Key Lab Intelligent Equipment Technol Agr, Beijing 100097, Peoples R China
[3] Beijing Res Ctr Intelligent Equipment Agr, Beijing Acad Agr & Forestry Sci, Beijing 100097, Peoples R China
[4] Natl Ctr Int Res Agr Aerial Applicat Technol, Beijing Acad Agr & Forestry Sci, Beijing 100097, Peoples R China
[5] Shandong Ruida Pest Control Co Ltd, Jinan 250000, Peoples R China
基金
中国国家自然科学基金;
关键词
deep learning; image segmentation; pine wilt disease; infected pine DeepLabv3+; focal loss; BURSAPHELENCHUS-XYLOPHILUS;
D O I
10.3390/rs13183594
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Pine wilt disease (PWD) is a serious threat to pine forests. Combining unmanned aerial vehicle (UAV) images and deep learning (DL) techniques to identify infected pines is the most efficient method to determine the potential spread of PWD over a large area. In particular, image segmentation using DL obtains the detailed shape and size of infected pines to assess the disease's degree of damage. However, the performance of such segmentation models has not been thoroughly studied. We used a fixed-wing UAV to collect images from a pine forest in Laoshan, Qingdao, China, and conducted a ground survey to collect samples of infected pines and construct prior knowledge to interpret the images. Then, training and test sets were annotated on selected images, and we obtained 2352 samples of infected pines annotated over different backgrounds. Finally, high-performance DL models (e.g., fully convolutional networks for semantic segmentation, DeepLabv3+, and PSPNet) were trained and evaluated. The results demonstrated that focal loss provided a higher accuracy and a finer boundary than Dice loss, with the average intersection over union (IoU) for all models increasing from 0.656 to 0.701. From the evaluated models, DeepLLabv3+ achieved the highest IoU and an F1 score of 0.720 and 0.832, respectively. Also, an atrous spatial pyramid pooling module encoded multiscale context information, and the encoder-decoder architecture recovered location/spatial information, being the best architecture for segmenting trees infected by the PWD. Furthermore, segmentation accuracy did not improve as the depth of the backbone network increased, and neither ResNet34 nor ResNet50 was the appropriate backbone for most segmentation models.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Application of unmanned aerial vehicle for detection of pine wilt disease
    Park, Joon Kyu
    Kim, Min Gyu
    [J]. ASIA LIFE SCIENCES, 2014, : 191 - 202
  • [2] Comparison of Deep Learning-Based Semantic Segmentation Models for Unmanned Aerial Vehicle Images
    Tippayamontri, Kan
    Khunlertgit, Navadon
    [J]. 2022 37TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC 2022), 2022, : 415 - 418
  • [3] Extraction of pine wilt disease based on a two-stage unmanned aerial vehicle deep learning method
    Huang, Xin
    Gang, Weilin
    Li, Jiayi
    Wang, Zhili
    Wang, Qun
    Liang, Yuegang
    [J]. JOURNAL OF APPLIED REMOTE SENSING, 2024, 18 (01)
  • [4] Deep learning-based dead pine tree detection from unmanned aerial vehicle images
    Tao, Huan
    Li, Cunjun
    Zhao, Dan
    Deng, Shiqing
    Hu, Haitang
    Xu, Xinluo
    Jing, Weibin
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2020, 41 (21) : 8238 - 8255
  • [5] Pine-YOLO: A Method for Detecting Pine Wilt Disease in Unmanned Aerial Vehicle Remote Sensing Images
    Yao, Junsheng
    Song, Bin
    Chen, Xuanyu
    Zhang, Mengqi
    Dong, Xiaotong
    Liu, Huiwen
    Liu, Fangchao
    Zhang, Li
    Lu, Yingbo
    Xu, Chang
    Kang, Ran
    [J]. FORESTS, 2024, 15 (05):
  • [6] Deep Learning for Weed Detection and Segmentation in Agricultural Crops Using Images Captured by an Unmanned Aerial Vehicle
    Silva, Josef Augusto Oberdan Souza
    Siqueira, Vilson Soares de
    Mesquita, Marcio
    Vale, Luís Sérgio Rodrigues
    Marques, Thiago do Nascimento Borges
    Silva, Jhon Lennon Bezerra da
    Silva, Marcos Vinícius da
    Lacerda, Lorena Nunes
    Oliveira-Júnior, José Francisco de
    Lima, João Luís Mendes Pedroso de
    Oliveira, Henrique Fonseca Elias de
    [J]. Remote Sensing, 2024, 16 (23)
  • [7] Highway Crack Segmentation From Unmanned Aerial Vehicle Images Using Deep Learning
    Hong, Zhonghua
    Yang, Fan
    Pan, Haiyan
    Zhou, Ruyan
    Zhang, Yun
    Han, Yanling
    Wang, Jing
    Yang, Shuhu
    Chen, Peng
    Tong, Xiaohua
    Liu, Jun
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [8] DEEP LEARNING FOR VEHICLE DETECTION IN AERIAL IMAGES
    Yang, Michael Ying
    Liao, Wentong
    Li, Xinbo
    Rosenhahn, Bodo
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 3079 - 3083
  • [9] Detection of diseased pine trees in unmanned aerial vehicle images by using deep convolutional neural networks
    Hu, Gensheng
    Zhu, Yanqiu
    Wan, Mingzhu
    Bao, Wenxia
    Zhang, Yan
    Liang, Dong
    Yin, Cunjun
    [J]. GEOCARTO INTERNATIONAL, 2022, 37 (12) : 3520 - 3539
  • [10] Unmanned aerial vehicle images in the machine learning for agave detection
    Escobar-Flores, Jonathan Gabriel
    Sandoval, Sarahi
    Gamiz-Romero, Eduardo
    [J]. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH, 2022, 29 (41) : 61662 - 61673