Integrating Uncertainty-Aware Human Motion Prediction Into Graph-Based Manipulator Motion Planning

被引:0
|
作者
Liu, Wansong [1 ]
Eltouny, Kareem [2 ]
Tian, Sibo [3 ]
Liang, Xiao [4 ]
Zheng, Minghui [3 ]
机构
[1] Univ Buffalo, Mech & Aerosp Engn Dept, Buffalo, NY 14260 USA
[2] Univ Buffalo, Civil Struct & Environm Engn Dept, Buffalo, NY 14260 USA
[3] Texas A&M Univ, J Mike Walker Dept Mech Engn 66, College Stn, TX 77840 USA
[4] Texas A&M Univ, Zachry Dept Civil & Environm Engn, College Stn, TX 77840 USA
基金
美国国家科学基金会;
关键词
Planning; Predictive models; Robots; Uncertainty; Trajectory; Manipulators; Robot motion; Graph neural network; human motion prediction; motion planning; SAFETY; MODEL;
D O I
10.1109/TMECH.2024.3402682
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
There has been a growing utilization of industrial robots as complementary collaborators for human workers in remanufacturing sites. Such a human-robot collaboration (HRC) aims to assist human workers in improving the flexibility and efficiency of labor-intensive tasks. In this article, we propose a human-aware motion planning framework for HRC to effectively compute collision-free motions for manipulators when conducting collaborative tasks with humans. We employ a neural human motion prediction model to enable proactive planning for manipulators. Particularly, rather than blindly trusting and utilizing predicted human trajectories in the manipulator planning, we quantify uncertainties of the neural prediction model to further ensure human safety. Moreover, we integrate the uncertainty-aware prediction into a graph that captures key workspace elements and illustrates their interconnections. Then, a graph neural network (GNN) is leveraged to operate on the constructed graph. Consequently, robot motion planning considers both the dependencies among all the elements in the workspace and the potential influence of future movements of human workers. We experimentally validate the proposed planning framework using a 6-degree-of-freedom manipulator in a shared workspace where a human is performing disassembling tasks. The results demonstrate the benefits of our approach in terms of improving the smoothness and safety of HRC. A brief video introduction of this work is available as the supplemental materials.
引用
收藏
页码:3128 / 3136
页数:9
相关论文
共 50 条
  • [1] UaMPNet: Uncertainty-Aware Motion Planning Network for Manipulator Motion Planning
    Lee, Eunhoo
    Yang, Hyunseok
    [J]. IEEE ACCESS, 2024, 12 : 63302 - 63316
  • [2] CCTR: Calibrating Trajectory Prediction for Uncertainty-Aware Motion Planning in Autonomous Driving
    Cao, Chengtai
    Chen, Xinhong
    Wang, Jianping
    Song, Qun
    Tan, Rui
    Li, Yung-Hui
    [J]. THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 19, 2024, : 20949 - 20957
  • [3] An Uncertainty-Aware Lane Change Motion Planning Algorithm Based on Probabilistic Trajectory Prediction Distribution
    Zhang, Zhiqiang
    Zhang, Lei
    Wang, Mingqiang
    Wang, Cong
    Wang, Zhenpo
    [J]. IEEE Open Journal of Vehicular Technology, 2024, 5 : 1386 - 1399
  • [4] Driving Environment Uncertainty-Aware Motion Planning for Autonomous Vehicles
    Tang, Xiaolin
    Yang, Kai
    Wang, Hong
    Yu, Wenhao
    Yang, Xin
    Liu, Teng
    Li, Jun
    [J]. CHINESE JOURNAL OF MECHANICAL ENGINEERING, 2022, 35 (01)
  • [5] Driving Environment Uncertainty-Aware Motion Planning for Autonomous Vehicles
    Xiaolin Tang
    Kai Yang
    Hong Wang
    Wenhao Yu
    Xin Yang
    Teng Liu
    Jun Li
    [J]. Chinese Journal of Mechanical Engineering, 2022, 35
  • [6] Driving Environment Uncertainty-Aware Motion Planning for Autonomous Vehicles
    Xiaolin Tang
    Kai Yang
    Hong Wang
    Wenhao Yu
    Xin Yang
    Teng Liu
    Jun Li
    [J]. Chinese Journal of Mechanical Engineering, 2022, 35 (05) : 317 - 330
  • [7] Graph-Based Motion Planning Networks
    Tai Hoang
    Ngo Anh Vien
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2020, PT II, 2021, 12458 : 557 - 573
  • [8] Vision-Based Uncertainty-Aware Motion Planning Based on Probabilistic Semantic Segmentation
    Roemer, Ralf
    Lederer, Armin
    Tesfazgi, Samuel
    Hirche, Sandra
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (11) : 7825 - 7832
  • [9] Holistic Graph-based Motion Prediction
    Grimm, Daniel
    Schoerner, Philip
    Dressler, Moritz
    Zoellner, J-Marius
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 2965 - 2972
  • [10] Motion- and Uncertainty-aware Path Planning for Micro Aerial Vehicles
    Achtelik, Markus W.
    Lynen, Simon
    Weiss, Stephan
    Chli, Margarita
    Siegwart, Roland
    [J]. JOURNAL OF FIELD ROBOTICS, 2014, 31 (04) : 676 - 698