A survey Of learning-Based control of robotic visual servoing systems

被引:30
|
作者
Wu, Jinhui [1 ]
Jin, Zhehao [1 ]
Liu, Andong [1 ]
Yu, Li [1 ]
Yang, Fuwen [2 ]
机构
[1] Zhejiang Univ Technol, Coll Informat Engn, Hangzhou, Peoples R China
[2] Griffith Univ Gold Coast, Sch Engn & Built Environm, Southport, Qld 4222, Australia
基金
中国国家自然科学基金;
关键词
EYE-TO-HAND; NEURAL-NETWORK; PREDICTIVE CONTROL; MOBILE ROBOTS; TRAJECTORY TRACKING; MANIPULATOR; STABILIZATION; CONSTRAINT; TASK;
D O I
10.1016/j.jfranklin.2021.11.009
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Major difficulties and challenges of modern robotics systems focus on how to give robots self-learning and self-decision-making ability. Visual servoing control strategy is an important strategy of robotic systems to perceive the environment via the vision. The vision can guide new robotic systems to complete more complicated tasks in complex working environments. This survey aims at describing the state-of-the-art learning-based algorithms, especially those algorithms that combine with model predictive control (MPC) used in visual servoing systems, and providing some pioneering and advanced references with several numerical simulations. The general modeling methods of visual servo and the influence of traditional control strategies on robotic visual servoing systems are introduced. The advantages of introducing neural-network-based algorithms and reinforcement-learning-based algorithms into the systems are discussed. Finally, according to the existing research progress and references, the future directions of robotic visual servoing systems are summarized and prospected. (C) 2021 The Franklin Institute. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:556 / 577
页数:22
相关论文
共 50 条
  • [31] Visual Servoing and Obstacle Avoidance Method based Control Autonomous Robotic Systems Servicing a Mechatronics Manufacturing Line
    Ciubucciu, George
    Solea, Razvan
    Filipescu, Adrian
    Filipescu, Adriana
    PROCEEDINGS OF THE 2017 9TH IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT DATA ACQUISITION AND ADVANCED COMPUTING SYSTEMS: TECHNOLOGY AND APPLICATIONS (IDAACS), VOL 2, 2017, : 874 - 879
  • [32] Image Moments Based Visual Control Algorithm for Servoing Systems
    Copot, Cosmin
    Burlacu, Adrian
    Lazar, Corneliu
    2009 IEEE 5TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTER COMMUNICATION AND PROCESSING, PROCEEDINGS, 2009, : 157 - 160
  • [33] Decoupled Image-Based Visual Servoing for Robotic Manufacturing Systems Using Gain Scheduled Switch Control
    Ghasemi, Ahmad
    Xie, Wen-Fang
    2017 INTERNATIONAL CONFERENCE ON ADVANCED MECHATRONIC SYSTEMS (ICAMECHS), 2017, : 94 - 99
  • [34] Visual servoing with deep learning and data augmentation for robotic manipulation
    Liu J.
    Li Y.
    Journal of Advanced Computational Intelligence and Intelligent Informatics, 2020, 24 (07): : 953 - 962
  • [35] Robotic Visual Servoing Based on Convolutional Neural Network
    Liu, Jingshu
    Li, Yuan
    Yang, Renxing
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 2245 - 2250
  • [36] A survey of deep learning-based visual question answering
    Huang, Tong-yuan
    Yang, Yu-ling
    Yang, Xue-jiao
    JOURNAL OF CENTRAL SOUTH UNIVERSITY, 2021, 28 (03) : 728 - 746
  • [37] Learning-Based Variable Compliance Control for Robotic Assembly
    Ren, Tianyu
    Dong, Yunfei
    Wu, Dan
    Chen, Ken
    JOURNAL OF MECHANISMS AND ROBOTICS-TRANSACTIONS OF THE ASME, 2018, 10 (06):
  • [38] Intelligent Visual Servoing Using Learning-Based Grasping Configurations and Adaptive Controller Gain
    Li, Jiqing
    Duan, Jianghua
    Ou, Yongsheng
    Xu, Sheng
    Wang, Zhiyang
    2020 IEEE INTERNATIONAL CONFERENCE ON REAL-TIME COMPUTING AND ROBOTICS (IEEE-RCAR 2020), 2020, : 357 - 362
  • [39] Stable visual servoing of camera-in-hand robotic systems
    Kelly, R
    Carelli, R
    Nasisi, O
    Kuchen, B
    Reyes, F
    IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2000, 5 (01) : 39 - 48
  • [40] Robot visual servoing with iterative learning control
    Jiang, P
    Unbehauen, R
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART A-SYSTEMS AND HUMANS, 2002, 32 (02): : 281 - 287