A survey Of learning-Based control of robotic visual servoing systems

被引:30
|
作者
Wu, Jinhui [1 ]
Jin, Zhehao [1 ]
Liu, Andong [1 ]
Yu, Li [1 ]
Yang, Fuwen [2 ]
机构
[1] Zhejiang Univ Technol, Coll Informat Engn, Hangzhou, Peoples R China
[2] Griffith Univ Gold Coast, Sch Engn & Built Environm, Southport, Qld 4222, Australia
基金
中国国家自然科学基金;
关键词
EYE-TO-HAND; NEURAL-NETWORK; PREDICTIVE CONTROL; MOBILE ROBOTS; TRAJECTORY TRACKING; MANIPULATOR; STABILIZATION; CONSTRAINT; TASK;
D O I
10.1016/j.jfranklin.2021.11.009
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Major difficulties and challenges of modern robotics systems focus on how to give robots self-learning and self-decision-making ability. Visual servoing control strategy is an important strategy of robotic systems to perceive the environment via the vision. The vision can guide new robotic systems to complete more complicated tasks in complex working environments. This survey aims at describing the state-of-the-art learning-based algorithms, especially those algorithms that combine with model predictive control (MPC) used in visual servoing systems, and providing some pioneering and advanced references with several numerical simulations. The general modeling methods of visual servo and the influence of traditional control strategies on robotic visual servoing systems are introduced. The advantages of introducing neural-network-based algorithms and reinforcement-learning-based algorithms into the systems are discussed. Finally, according to the existing research progress and references, the future directions of robotic visual servoing systems are summarized and prospected. (C) 2021 The Franklin Institute. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:556 / 577
页数:22
相关论文
共 50 条
  • [1] Deep learning-based pose prediction for visual servoing of robotic manipulators using image similarity
    He, Yaozhen
    Gao, Jian
    Chen, Yimin
    NEUROCOMPUTING, 2022, 491 : 343 - 352
  • [2] Classical and Deep Learning based Visual Servoing Systems: a Survey on State of the Art
    Zakariae Machkour
    Daniel Ortiz-Arroyo
    Petar Durdevic
    Journal of Intelligent & Robotic Systems, 2022, 104
  • [3] Classical and Deep Learning based Visual Servoing Systems: a Survey on State of the Art
    Machkour, Zakariae
    Ortiz-Arroyo, Daniel
    Durdevic, Petar
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2022, 104 (01)
  • [4] A Survey on Learning-Based Robotic Grasping
    Kilian Kleeberger
    Richard Bormann
    Werner Kraus
    Marco F. Huber
    Current Robotics Reports, 2020, 1 (4): : 239 - 249
  • [5] A machine learning-based visual servoing approach for fast robot control in industrial setting
    Castelli, Francesco
    Michieletto, Stefano
    Ghidoni, Stefano
    Pagello, Enrico
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2017, 14 (06):
  • [6] Switching control of Image Based Visual Servoing with laser pointer in robotic assembly systems
    Li, Z.
    Xie, W. F.
    Tu, X. W.
    Perron, C.
    2007 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS, VOLS 1-8, 2007, : 1111 - +
  • [7] Reinforcement learning for appearance based visual servoing in robotic manipulation
    Khan, Umar
    Khan, Liaquat Ali
    Hussain, S. Zahid
    ROBOTICS, CONTROL AND MANUFACTURING TECHNOLOGY, 2008, : 161 - 168
  • [8] Visual servoing of a robotic manipulator based on fuzzy logic control
    De Giuseppe, R
    Taurisano, F
    Distante, C
    Anglani, A
    ICRA '99: IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-4, PROCEEDINGS, 1999, : 1487 - 1494
  • [9] Imitation Learning-Based Visual Servoing for Tracking Moving Objects
    Felici, Rocco
    Saveriano, Matteo
    Roveda, Loris
    Paolillo, Antonio
    HUMAN-FRIENDLY ROBOTICS 2023, HFR 2023, 2024, 29 : 110 - 122
  • [10] Shape morphing-based control of robotic visual servoing
    Singh, R
    Voyles, RM
    Littau, D
    Papanikolopoulos, NP
    AUTONOMOUS ROBOTS, 2001, 10 (03) : 317 - 338