Integrating Uncertainty-Aware Human Motion Prediction Into Graph-Based Manipulator Motion Planning

被引:0
|
作者
Liu, Wansong [1 ]
Eltouny, Kareem [2 ]
Tian, Sibo [3 ]
Liang, Xiao [4 ]
Zheng, Minghui [3 ]
机构
[1] Univ Buffalo, Mech & Aerosp Engn Dept, Buffalo, NY 14260 USA
[2] Univ Buffalo, Civil Struct & Environm Engn Dept, Buffalo, NY 14260 USA
[3] Texas A&M Univ, J Mike Walker Dept Mech Engn 66, College Stn, TX 77840 USA
[4] Texas A&M Univ, Zachry Dept Civil & Environm Engn, College Stn, TX 77840 USA
基金
美国国家科学基金会;
关键词
Planning; Predictive models; Robots; Uncertainty; Trajectory; Manipulators; Robot motion; Graph neural network; human motion prediction; motion planning; SAFETY; MODEL;
D O I
10.1109/TMECH.2024.3402682
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
There has been a growing utilization of industrial robots as complementary collaborators for human workers in remanufacturing sites. Such a human-robot collaboration (HRC) aims to assist human workers in improving the flexibility and efficiency of labor-intensive tasks. In this article, we propose a human-aware motion planning framework for HRC to effectively compute collision-free motions for manipulators when conducting collaborative tasks with humans. We employ a neural human motion prediction model to enable proactive planning for manipulators. Particularly, rather than blindly trusting and utilizing predicted human trajectories in the manipulator planning, we quantify uncertainties of the neural prediction model to further ensure human safety. Moreover, we integrate the uncertainty-aware prediction into a graph that captures key workspace elements and illustrates their interconnections. Then, a graph neural network (GNN) is leveraged to operate on the constructed graph. Consequently, robot motion planning considers both the dependencies among all the elements in the workspace and the potential influence of future movements of human workers. We experimentally validate the proposed planning framework using a 6-degree-of-freedom manipulator in a shared workspace where a human is performing disassembling tasks. The results demonstrate the benefits of our approach in terms of improving the smoothness and safety of HRC. A brief video introduction of this work is available as the supplemental materials.
引用
收藏
页码:3128 / 3136
页数:9
相关论文
共 50 条
  • [31] Abstraction-Based Planning for Uncertainty-Aware Legged Navigation
    Jiang, Jesse
    Coogan, Samuel
    Zhao, Ye
    [J]. IEEE OPEN JOURNAL OF CONTROL SYSTEMS, 2023, 2 : 221 - 234
  • [32] People Finding Under Visibility Constraints Using Graph-Based Motion Prediction
    Bayoumi, AbdElMoniem
    Karkowski, Philipp
    Bennewitz, Maren
    [J]. INTELLIGENT AUTONOMOUS SYSTEMS 15, IAS-15, 2019, 867 : 546 - 557
  • [33] Uncertainty-aware asynchronous scattered motion interpolation using Gaussian process regression
    Kocev, Bojan
    Hahn, Horst Karl
    Linsen, Lars
    Wells, William M.
    Kikinis, Ron
    [J]. COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2019, 72 : 1 - 12
  • [34] MUNet: Motion uncertainty-aware semi-supervised video object segmentation
    Sun, Jiadai
    Mao, Yuxin
    Dai, Yuchao
    Zhong, Yiran
    Wang, Jianyuan
    [J]. PATTERN RECOGNITION, 2023, 138
  • [35] Uncertainty-Aware Trajectory Planning: Using Uncertainty Quantification and Propagation in Traversability Prediction of Planetary Rovers
    Takemura, Reiya
    Ishigami, Genya
    [J]. IEEE ROBOTICS & AUTOMATION MAGAZINE, 2024, 31 (02) : 89 - 99
  • [36] Limited Visibility and Uncertainty Aware Motion Planning for Automated Driving
    Tas, Omer Sahin
    Stiller, Christoph
    [J]. 2018 IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2018, : 1171 - 1178
  • [37] A Localization Aware Sampling Strategy for Motion Planning under Uncertainty
    Pilania, Vinay
    Gupta, Kamal
    [J]. 2015 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2015, : 6093 - 6099
  • [38] An Uncertainty-Aware Hybrid Approach for Sea State Estimation Using Ship Motion Responses
    Han, Peihua
    Li, Guoyuan
    Cheng, Xu
    Skjong, Stian
    Zhang, Houxiang
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (02) : 891 - 900
  • [39] Motion Model for Positioning with Graph-Based Indoor Map
    Nurminen, Henri
    Koivisto, Mike
    Ali-Loytty, Simo
    Piche, Robert
    [J]. 2014 INTERNATIONAL CONFERENCE ON INDOOR POSITIONING AND INDOOR NAVIGATION (IPIN), 2014, : 646 - 655
  • [40] Context-aware Human Motion Prediction
    Corona, Enric
    Pumarola, Albert
    Alenya, Guillem
    Moreno-Noguer, Francesc
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 6990 - 6999