Key Technologies for Machine Vision for Picking Robots: Review and Benchmarking

被引:0
|
作者
Xiao, Xu [1 ,2 ]
Jiang, Yiming [1 ,2 ]
Wang, Yaonan [1 ,2 ]
机构
[1] Hunan Univ, Coll Elect & Informat Engn, Changsha 410082, Peoples R China
[2] Hunan Univ, Natl Engn Res Ctr Robot Vis Percept & Control Tech, Changsha 410082, Peoples R China
基金
中国国家自然科学基金;
关键词
Picking robot; visual system; perception technology; image processing; machine learning; deep learning; FRUIT RECOGNITION; FEATURES;
D O I
10.1007/s11633-024-1517-1
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The increase in precision agriculture has promoted the development of picking robot technology, and the visual recognition system at its core is crucial for improving the level of agricultural automation. This paper reviews the progress of visual recognition technology for picking robots, including image capture technology, target detection algorithms, spatial positioning strategies and scene understanding. This article begins with a description of the basic structure and function of the vision system of the picking robot and emphasizes the importance of achieving high-efficiency and high-accuracy recognition in the natural agricultural environment. Subsequently, various image processing techniques and vision algorithms, including color image analysis, three-dimensional depth perception, and automatic object recognition technology that integrates machine learning and deep learning algorithms, were analysed. At the same time, the paper also highlights the challenges of existing technologies in dynamic lighting, occlusion problems, fruit maturity diversity, and real-time processing capabilities. This paper further discusses multisensor information fusion technology and discusses methods for combining visual recognition with a robot control system to improve the accuracy and working rate of picking. At the same time, this paper also introduces innovative research, such as the application of convolutional neural networks (CNNs) for accurate fruit detection and the development of event-based vision systems to improve the response speed of the system. At the end of this paper, the future development of visual recognition technology for picking robots is predicted, and new research trends are proposed, including the refinement of algorithms, hardware innovation, and the adaptability of technology to different agricultural conditions. The purpose of this paper is to provide a comprehensive analysis of visual recognition technology for researchers and practitioners in the field of agricultural robotics, including current achievements, existing challenges and future development prospects.
引用
收藏
页码:2 / 16
页数:15
相关论文
共 50 条
  • [41] Research on key technologies of small underwater robots
    Zhang H.
    International Journal of Simulation: Systems, Science and Technology, 2016, 17 (47): : 14.1 - 14.7
  • [42] A Research for Intelligent Cotton Picking Robot Based on Machine Vision
    Wang, Mulan
    Wei, Jieding
    Yuan, Jianning
    Xu, Kaiyun
    2008 INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION, VOLS 1-4, 2008, : 800 - +
  • [43] Editorial: Machine Vision for Assistive Technologies
    Leo, Marco
    Farinella, Giovanni Maria
    Furnari, Antonino
    Medioni, Gerard
    FRONTIERS IN COMPUTER SCIENCE, 2022, 4
  • [44] SOFTWARE ARCHITECTURE OF MACHINE VISION FOR ROVING ROBOTS
    TOU, JT
    OPTICAL ENGINEERING, 1986, 25 (03) : 428 - 435
  • [45] ADAPTIVE INDUSTRIAL ROBOTS USING MACHINE VISION
    Kuts, Vladimir
    Otto, Tauno
    Tahemaa, Toivo
    Bukhari, Khuldoon
    Pataraia, Tengiz
    PROCEEDINGS OF THE ASME INTERNATIONAL MECHANICAL ENGINEERING CONGRESS AND EXPOSITION, 2018, VOL 2, 2019,
  • [46] Robotic vision system for random bin picking with dual-arm robots
    Kang, Sangseung
    Kim, Kyekyung
    Lee, Jaeyeon
    Kim, Joongbae
    2016 INTERNATIONAL CONFERENCE ON MEASUREMENT INSTRUMENTATION AND ELECTRONICS (ICMIE 2016), 2016, 75
  • [47] Global Energy Interconnection vision and key technologies
    Zhou, Yuanbing
    CHINESE SCIENCE BULLETIN-CHINESE, 2019, 64 (19): : 1985 - 1994
  • [48] Classification-design-optimization integrated picking robots: a review
    Xiang, Jingyang
    Wang, Lianguo
    Li, Li
    Lai, Kee-Hung
    Cai, Wei
    JOURNAL OF INTELLIGENT MANUFACTURING, 2024, 35 (07) : 2979 - 3002
  • [49] Key technologies of tracking and positioning of intelligent robots in oil and gas pipelines: A review of recent advances
    Guo, Jingbo
    Cai, Xiong
    Hu, Tiehua
    Zhang, Zhiwen
    Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2015, 36 (03): : 481 - 498
  • [50] The Analysis of Key Technologies for Advanced Intelligent Quadruped Robots
    Dang Ruina
    Jiang Chenxing
    Li Ning
    Liang Zhenjie
    Zhao Honglei
    Su Bo
    2019 4TH INTERNATIONAL CONFERENCE ON CONTROL, ROBOTICS AND CYBERNETICS (CRC 2019), 2019, : 70 - 74