UAV Sensing-Based Litchi Segmentation Using Modified Mask-RCNN for Precision Agriculture

Traditional methods of manual litchi fruit counting are labor-intensive, time-consuming, and prone to errors. Moreover, due to its complex growth structures, such as occlusion with leaves and branches, overlapping, and uneven color, it becomes more challenging for the current baseline detection and instance segmentation models to accurately identify the litchi fruits. The advancement of deep learning architecture and modern sensing technology, such as unmanned aerial vehicle (UAV), had shown great potential for improving fruit counting accuracy and efficiency. In this article, we propose a modified Mask-region-based convolutional neural network-based instance segmentation model using channel attention to detect and count litchis in complex natural environments using UAV. In addition, we build a UAV-Litchi dataset consisting of 1000 images with 31 000 litchi annotations, collected by the DJI Phantom 4 with RGB sensor and labeled with a LabelImg annotation tool. Experimental results show that the proposed model with the squeeze-and-excitation block improves the detection accuracy of litchi fruits, achieving a mean average precision, recall, and F1 score of 81.47%, 92.81%, and 88.40%, respectively, with an average inference time of 7.72 s. The high accuracy and efficiency of the proposed model demonstrate its potential for precise and accurate litchi detection in precision agriculture. © 2024 IEEE.