Comparison of grape flower counting using patch-based instance segmentation and density-based estimation with Convolutional Neural Networks

被引:5
|
作者
Rahim, Umme Fawzia [1 ]
Utsumi, Tomoyoshi [3 ]
Mineno, Hiroshi [1 ,2 ]
机构
[1] Shizuoka Univ, Grad Sch Integrated Sci & Technol, Naka Ku, 3-5-1 Johoku, Hamamatsu, Shizuoka 4328081, Japan
[2] Shizuoka Univ, Res Inst Green Sci & Technol, Naka Ku, 3-5-1 Johoku, Hamamatsu, Shizuoka 4328081, Japan
[3] Yamaha Motor CO LTD, Tech Res & Dev Ctr, 3001-10 Kuno, Fukuroi, Shizuoka 4370061, Japan
基金
日本科学技术振兴机构;
关键词
Computer vision-based phenotyping; flower counting; instance segmentation; object density map; convolutional neural network (CNN); grape yield estimation; IMAGE-ANALYSIS; NUMBER; INFLORESCENCE;
D O I
10.1117/12.2605670
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Information on flower number per grapevine inflorescence is critical for grapevine genetic improvement, early yield estimation and vineyard management. Previous approaches to automize this process by traditional image processing techniques, are unsuccessful in the improvement of a universal system that can be applied to inflorescences with diverse morphology. In this paper, we validated the efficiency of advanced deep learning-based approaches for automatic flower number estimation. The results were analyzed on an inflorescence dataset of 204 images from four different cultivars during various growth stages. The algorithm developed on patch-based instance segmentation using Mask R-CNN, produced counting results highly correlated to manual counts (R-2 = 0.96). Practically constant MAPE values among different cultivars (from 5.50% to 8.45%), implying a high robustness in this method. Achieving the fastest counting (0.33 second per image of size 512 x 512) with slightly lower counting accuracy (R-2 = 0.91), the method based on object density-map using U-Net turned out to be suitable for real-time flower counting systems.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Crowd density estimation based on convolutional neural networks with mixed pooling
    Zhang, Li
    Zheng, Hong
    Zhang, Ying
    Zhang, Dongming
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2017, 26 (05)
  • [32] Lung Nodule Detection in CT Images Using a Raw Patch-Based Convolutional Neural Network
    Wang, Qin
    Shen, Fengyi
    Shen, Linyao
    Huang, Jia
    Sheng, Weiguang
    [J]. JOURNAL OF DIGITAL IMAGING, 2019, 32 (06) : 971 - 979
  • [33] Lung Nodule Detection in CT Images Using a Raw Patch-Based Convolutional Neural Network
    Qin Wang
    Fengyi Shen
    Linyao Shen
    Jia Huang
    Weiguang Sheng
    [J]. Journal of Digital Imaging, 2019, 32 : 971 - 979
  • [34] Instance Segmentation and Berry Counting of Table Grape before Thinning Based on AS-SwinT
    Du, Wensheng
    Liu, Ping
    [J]. PLANT PHENOMICS, 2023, 5
  • [35] Automated segmentation of head CT scans for computer-assisted craniomaxillofacial surgery applying a hierarchical patch-based stack of convolutional neural networks
    Steybe, David
    Poxleitner, Philipp
    Metzger, Marc Christian
    Brandenburg, Leonard Simon
    Schmelzeisen, Rainer
    Bamberg, Fabian
    Phuong Hien Tran
    Kellner, Elias
    Reisert, Marco
    Russe, Maximilian Frederik
    [J]. INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2022, 17 (11) : 2093 - 2101
  • [36] Automated segmentation of head CT scans for computer-assisted craniomaxillofacial surgery applying a hierarchical patch-based stack of convolutional neural networks
    David Steybe
    Philipp Poxleitner
    Marc Christian Metzger
    Leonard Simon Brandenburg
    Rainer Schmelzeisen
    Fabian Bamberg
    Phuong Hien Tran
    Elias Kellner
    Marco Reisert
    Maximilian Frederik Russe
    [J]. International Journal of Computer Assisted Radiology and Surgery, 2022, 17 : 2093 - 2101
  • [37] Estimation and counting of wheat ears density in field based on deep convolutional neural network
    Bao W.
    Zhang X.
    Hu G.
    Huang L.
    Liang D.
    Lin Z.
    [J]. Nongye Gongcheng Xuebao/Transactions of the Chinese Society of Agricultural Engineering, 2020, 36 (21): : 186 - 193
  • [38] Landmark Localization for Cephalometric Analysis Using Multiscale Image Patch-Based Graph Convolutional Networks
    Lu, Gang
    Zhang, Yuanxiu
    Kong, Youyong
    Zhang, Chen
    Coatrieux, Jean-Louis
    Shu, Huazhong
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (07) : 3015 - 3024
  • [39] Patch-based segmentation using expert priors: Application to hippocampus and ventricle segmentation
    Coupe, Pierrick
    Manjon, Jose V.
    Fonov, Vladimir
    Pruessner, Jens
    Robles, Montserrat
    Collins, D. Louis
    [J]. NEUROIMAGE, 2011, 54 (02) : 940 - 954
  • [40] Fingerprint Presentation Attack Detection Using A Novel Multi-Spectral Capture Device and Patch-Based Convolutional Neural Networks
    Hussein, Mohamed E.
    Spinoulas, Leonidas
    Xiong, Fei
    Abd-Almageed, Wael
    [J]. 2018 10TH IEEE INTERNATIONAL WORKSHOP ON INFORMATION FORENSICS AND SECURITY (WIFS), 2018,