Red Ripe Strawberry Recognition and Stem Detection Based on Improved YOLO v8-Pose

被引:0
|
作者
Liu M. [1 ,2 ]
Chu Z. [1 ]
Cui M. [1 ]
Yang Q. [1 ]
Wang J. [1 ,3 ]
Yang H. [1 ,4 ]
机构
[1] College of Mechanical and Electronic Engineering, Shandong Agricultural University, Taian
[2] Shandong Engineering Laboratory of Agricultural Equipment Intelligence, Taian
[3] Shandong Provincial Key Laboratory of Horticultural Machinery and Equipment, Taian
[4] Shandong Academy of Agricultural Machinery Sciences, Ji'nan
关键词
attention mechanism; key point prediction; red ripe strawberry recognition; YOLO v8 — Pose;
D O I
10.6041/j.issn.1000-1298.2023.S2.029
中图分类号
学科分类号
摘要
The improved YOLO v8 — Pose model was established to identify red ripe strawberries and detect the key points of the stem in greenhouse strawberries under elevated cultivation mode. By comparing the YOLO v5 - Pose, YOLO v7 - Pose and YOLO v8 - Pose models, the YOLO v8 - Pose model was determined to be used as the model to identify and predict the key points of red ripe strawberries. Based on YOLO v8 — Pose, Slim — neck module and CBAM attention mechanism module were added to its network structure to improve the feature extraction ability of the model for small target objects, so as to adapt to the characteristics of strawberry data set. The P, R and mAP-kp of the improved YOLO v8 — Pose were 98. 14%, 94. 54% and 97. 91%, respectively, which can effectively detect red ripe strawberries and accurately mark the key points of the fruit stalk, which was 5. 41, 5. 31 and 8. 29 percentage points higher than that of YOLO v8 — Pose. The model memory footprint was 22 MB, which was 6 MB less than that of the YOLO v8 — Pose footprint. In addition, according to the unstructured characteristics of the orchard, the influence of light, occlusion and shooting angle on the model prediction was explored. Compared with the recognition and stem prediction of the improved YOLO v8 —Pose model in the complex environment, the mAP-kp of the improved YOLO v8 — Pose under the influence of occlusion, light and angle was 94.52%, 95.48% and 94.63%, respectively. Compared with YOLO v8 —Pose, it was 8. 9, 10. 75 and 5. 17 percentage points higher, respectively. The improved YOLO v8 -Pose can ensure the accuracy of the network model, and at the same time, it had good robustness to the effects of occlusion, light and shooting angle, etc., which can realize the identification of red ripe strawberries in complex environments and the prediction of key points of fruit stalk. © 2023 Chinese Society of Agricultural Machinery. All rights reserved.
引用
收藏
页码:244 / 251
页数:7
相关论文
共 26 条
  • [1] JI Liwen, LIU Yonghua, GAO Juling, Et al., Design and experiment of strawberry picking robot in greenhouse [J], Journal of Chinese Agricultural Mechanization, 44, 1, pp. 192-198, (2023)
  • [2] HAN Yongqian, SUN Bugong, ZHANG Peng, Et al., Research progress of agricultural pick robot [J], Forestry Machinery & Woodworking Equipment, 51, 4, pp. 4-8, (2023)
  • [3] LIU Xiaogang, FAN Cheng, LI Jianian, Et al., Identification method of strawberry based on convolutional neural network [J], Transactions of the Chinese Society for Agricultural Machinery, 51, 2, pp. 237-244, (2020)
  • [4] SUN Jun, CHEN Yide, ZH0U Xin, Et al., Improved YOLO v4 — Tiny model for fast and accurate recognition of strawberry in the shed, Transactions of the CSAE, 38, 18, pp. 195-203, (2022)
  • [5] LI Yang, YAO Caihong, GAO Guanqun, Et al., A target detection method based on YOLO v5 in multi-stage of strawberry growing period [J], Tianjin Agricultural Sciences, 28, 11, pp. 90-91, (2022)
  • [6] ZHANG Kailiang, YANG Li, WANG Liangju, Et al., Design and experiment of elevated substrate culture strawberry picking robot [J], Transactions of the Chinese Society for Agricultural Machinery, 43, 9, pp. 165-172, (2012)
  • [7] GUO F, CAO Q X, CUI Y J, Et al., Fruit location and stem detection method for strawberry harvesting robot [J], Transactions of the CSAE, 24, 10, pp. 89-94, (2008)
  • [8] YU Y, ZHANG K L, LIU H, Et al., Real-time visual localization of the picking points for a ridge-planting strawberry harvesting robot[C], IEEE Access, 8, pp. 116556-116568, (2020)
  • [9] JEONG T Y, HA L K., Openpose based smoking gesture recognition system using artificial neural network [J], Technical Journal, 17, 2, pp. 251-259, (2023)
  • [10] LI Huibin, SHI Yun, LIU Huaiyang, Et al., Improved detection of apple growth direction based on Openpose [J], China Agricultural Informatics, 34, 6, pp. 34-48, (2022)