Fruit recognition method for a harvesting robot with RGB-D cameras

被引：21
|
作者：
Yoshida, Takeshi [1 ]
Kawahara, Takuya [2 ]
Fukao, Takanori [3 ]
机构：
[1] Res Ctr Agr Robot, Natl Agr & Food Res Org, Tsukuba, Ibaraki, Japan
[2] Ritsumeikan Univ, Grad Sch Sci & Engn, Kusatsu, Japan
[3] Univ Tokyo, Grad Sch Informat Sci & Technol, Bunkyo, Japan
来源：
ROBOMECH JOURNAL | 2022年 / 9卷 / 01期
关键词：
Harvesting robot; Object detection; Machine learning; COLOR;
D O I：
10.1186/s40648-022-00230-y
中图分类号：
TH7 [仪器、仪表];
学科分类号：
0804 ; 080401 ; 081102 ;
摘要：
In this study, we present a recognition method for a fruit-harvesting robot to automate the harvesting of pears and apples on joint V-shaped trellis. It is necessary to recognize the three-dimensional position of the harvesting target for harvesting by the fruit-harvesting robot to insert its end-effector. However, the RGB-D (red, green, blue and depth) camera on the harvesting robot has a problem in that the point cloud obtained in outdoor environments can be inaccurate. Therefore, in this study, we propose an effective method for the harvesting robot to recognize fruits using not only three-dimensional information obtained from the RGB-D camera but also two-dimensional images and information from the camera. Furthermore, we report a method for determining the ripeness of pears using the information on fruit detection. Through experiments, we confirmed that the proposed method satisfies the accuracy required for a harvesting robot to continuously harvest fruits.
引用
下载
收藏
页数：10
相关论文
共 50 条
  • [1] Fruit recognition method for a harvesting robot with RGB-D cameras
    Takeshi Yoshida
    Takuya Kawahara
    Takanori Fukao
    ROBOMECH Journal, 9
  • [2] A method proposal of scene recognition for RGB-D cameras
    Danciu, Gabriel-Mihail
    2016 IEEE 11TH INTERNATIONAL SYMPOSIUM ON APPLIED COMPUTATIONAL INTELLIGENCE AND INFORMATICS (SACI), 2016, : 301 - 304
  • [3] Multimodal Emotion Recognition with Thermal and RGB-D Cameras for Human-Robot Interaction
    Yu, Chuang
    Tapus, Adriana
    HRI'20: COMPANION OF THE 2020 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, 2020, : 532 - 534
  • [4] Fall Recovery Subactivity Recognition With RGB-D Cameras
    Withanage, Kalana Ishara
    Lee, Ivan
    Brinkworth, Russell
    Mackintosh, Shylie
    Thewlis, Dominic
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2016, 12 (06) : 2312 - 2320
  • [5] Kick Recognition System Using Dual RGB-D Cameras
    Hong, Sungjin
    Kim, Myung-Gyu
    Kim, Yejin
    PROCEEDINGS OF 2018 THE 2ND INTERNATIONAL CONFERENCE ON VIDEO AND IMAGE PROCESSING (ICVIP 2018), 2018, : 12 - 16
  • [6] A New Visual Speech Recognition Approach for RGB-D Cameras
    Rekik, Ahmed
    Ben-Hamadou, Achraf
    Mahdi, Walid
    IMAGE ANALYSIS AND RECOGNITION, ICIAR 2014, PT II, 2014, 8815 : 21 - 28
  • [7] A litchi fruit recognition method in a natural environment using RGB-D images
    Yu, Lianyi
    Xiong, Juntao
    Fang, Xueqing
    Yang, Zhengang
    Chen, Yunqi
    Lin, Xiaoyun
    Chen, Shufang
    BIOSYSTEMS ENGINEERING, 2021, 204 : 50 - 63
  • [8] A litchi fruit recognition method in a natural environment using RGB-D images
    Yu, Lianyi
    Xiong, Juntao
    Fang, Xueqing
    Yang, Zhengang
    Chen, Yunqi
    Lin, Xiaoyun
    Chen, Shufang
    Biosystems Engineering, 2021, 204 : 50 - 63
  • [9] Line Detecting and Tracking of a Mobile Robot with Multiple RGB-D Cameras
    Huang, Cheng-Ming
    Yang, Ting-Yi
    2016 IEEE 13TH INTERNATIONAL CONFERENCE ON NETWORKING, SENSING, AND CONTROL (ICNSC), 2016,
  • [10] Line Detecting and Tracking of a Mobile Robot with Multiple RGB-D Cameras
    Huang, Cheng-Ming
    Yang, Ting-Yi
    2016 IEEE 13TH INTERNATIONAL CONFERENCE ON NETWORKING, SENSING, AND CONTROL (ICNSC), 2016,
12345