Virtual-Goal-Guided RRT for Visual Servoing of Mobile Robots With FOV Constraint

被引:26
|
作者
Wang, Runhua [1 ,2 ]
Zhang, Xuebo [1 ,2 ]
Fang, Yongchun [1 ,2 ]
Li, Baoquan [3 ]
机构
[1] Nankai Univ, Coll Artificial Intelligence, Inst Robot & Automat Informat Syst, Tianjin 300071, Peoples R China
[2] Nankai Univ, Tianjin Key Lab Intelligent Robot, Tianjin 300071, Peoples R China
[3] Tianjin Polytech Univ, Sch Elect Engn & Automat, Tianjin 300387, Peoples R China
基金
中国国家自然科学基金;
关键词
Mobile robots; Visual servoing; Robots; Trajectory; Robot kinematics; Cameras; Visualization; Field-of-view (FOV) constraint; mobile robots; rapidly exploring random tree (RRT); trajectory planning; visual servoing; TRAJECTORY TRACKING; ALGORITHM;
D O I
10.1109/TSMC.2020.3044347
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, a virtual-goal-guided rapidly exploring random tree (RRT)-based visual servoing approach is proposed for nonholonomic mobile robots to simultaneously satisfy the field-of-view (FOV) constraint and the velocity constraints during the motion toward the desired pose. The presented approach contains two parts: 1) trajectory planning in the scaled Euclidean space and 2) trajectory tracking control. For the trajectory planning part, a new virtual-goal-guided RRT algorithm is designed to guarantee the FOV constraint and the velocity constraints by iteratively exploring the scaled Euclidean space in the presence of unknown image depth. Specifically, a virtual goal directly behind the desired pose is set to guide the tree to extend laterally into the area wherein the robot is easier to satisfy the FOV constraint. In addition, the lateral extension of the tree also helps decrease the lateral error of the robot as much as possible. Following each successful extension toward the virtual goal node, a greedy extension from the newly explored node to the desired pose is attempted using a polar stabilization controller, so that the planned trajectory can accurately arrive at the desired pose. Each newly explored edge in the scaled space is projected into the image space to check for the FOV limit. For the visual tracking part, the final searched trajectory in the scaled space is first transformed into image feature trajectories, which are then tracked by an image-based visual tracking controller. Experiments validate the effectiveness of the proposed approach.
引用
收藏
页码:2073 / 2083
页数:11
相关论文
共 50 条
  • [1] CBF Based Geometric Visual Servoing Control for Quadrotors with FOV Constraint
    Zhang, Haoran
    Wang, Runhua
    Zhang, Xuetao
    Li, Tianyi
    Zhang, Shiyong
    Zhang, Xuebo
    [J]. PROCEEDINGS OF 2022 INTERNATIONAL CONFERENCE ON AUTONOMOUS UNMANNED SYSTEMS, ICAUS 2022, 2023, 1010 : 3834 - 3843
  • [2] Deep Reinforcement Learning for the Visual Servoing Control of UAVs with FOV Constraint
    Fu, Gui
    Chu, Hongyu
    Liu, Liwen
    Fang, Linyi
    Zhu, Xinyu
    [J]. DRONES, 2023, 7 (06)
  • [3] A survey on visual servoing for wheeled mobile robots
    Chenping Li
    Baoquan Li
    Runhua Wang
    Xuebo Zhang
    [J]. International Journal of Intelligent Robotics and Applications, 2021, 5 : 203 - 218
  • [4] Intelligent Visual Servoing for Nonholonomic Mobile Robots
    Lopez-Franco, Carlos
    Lopez-Franco, Michel
    Sanchez, Edgar N.
    Alanis, Alma Y.
    [J]. PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 1488 - 1493
  • [5] A survey on visual servoing for wheeled mobile robots
    Li, Chenping
    Li, Baoquan
    Wang, Runhua
    Zhang, Xuebo
    [J]. INTERNATIONAL JOURNAL OF INTELLIGENT ROBOTICS AND APPLICATIONS, 2021, 5 (02) : 203 - 218
  • [6] Uncalibrated Visual Servoing of Nonholonomic Mobile Robots
    Li, Baoquan
    Fang, Yongchun
    Zhang, Xuebo
    [J]. 2013 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2013, : 584 - 589
  • [7] ROBUST REGULATION of NONHOLONOMIC MOBILE ROBOTS WITH VISUAL SERVOING
    Wang, Chaoli
    Mei, Yingchun
    Liao, Qinwu
    [J]. 2008 7TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-23, 2008, : 2153 - 2158
  • [8] Adaptive Active Visual Servoing of Nonholonomic Mobile Robots
    Fang, Yongchun
    Liu, Xi
    Zhang, Xuebo
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2012, 59 (01) : 486 - 497
  • [9] An Active Visual Servoing Strategy for Nonholonomic Mobile Robots
    Liu, Xi
    Fang, Yongchun
    Zhang, Xuebo
    [J]. PROCEEDINGS OF THE 48TH IEEE CONFERENCE ON DECISION AND CONTROL, 2009 HELD JOINTLY WITH THE 2009 28TH CHINESE CONTROL CONFERENCE (CDC/CCC 2009), 2009, : 6011 - 6016
  • [10] Epipole-based visual servoing for mobile robots
    Chesi, G
    Mariottini, GL
    Prattichizzo, D
    Vicino, A
    [J]. ADVANCED ROBOTICS, 2006, 20 (02) : 255 - 280