Integrating Uncertainty-Aware Human Motion Prediction Into Graph-Based Manipulator Motion Planning

被引:0
|
作者
Liu, Wansong [1 ]
Eltouny, Kareem [2 ]
Tian, Sibo [3 ]
Liang, Xiao [4 ]
Zheng, Minghui [3 ]
机构
[1] Univ Buffalo, Mech & Aerosp Engn Dept, Buffalo, NY 14260 USA
[2] Univ Buffalo, Civil Struct & Environm Engn Dept, Buffalo, NY 14260 USA
[3] Texas A&M Univ, J Mike Walker Dept Mech Engn 66, College Stn, TX 77840 USA
[4] Texas A&M Univ, Zachry Dept Civil & Environm Engn, College Stn, TX 77840 USA
基金
美国国家科学基金会;
关键词
Planning; Predictive models; Robots; Uncertainty; Trajectory; Manipulators; Robot motion; Graph neural network; human motion prediction; motion planning; SAFETY; MODEL;
D O I
10.1109/TMECH.2024.3402682
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
There has been a growing utilization of industrial robots as complementary collaborators for human workers in remanufacturing sites. Such a human-robot collaboration (HRC) aims to assist human workers in improving the flexibility and efficiency of labor-intensive tasks. In this article, we propose a human-aware motion planning framework for HRC to effectively compute collision-free motions for manipulators when conducting collaborative tasks with humans. We employ a neural human motion prediction model to enable proactive planning for manipulators. Particularly, rather than blindly trusting and utilizing predicted human trajectories in the manipulator planning, we quantify uncertainties of the neural prediction model to further ensure human safety. Moreover, we integrate the uncertainty-aware prediction into a graph that captures key workspace elements and illustrates their interconnections. Then, a graph neural network (GNN) is leveraged to operate on the constructed graph. Consequently, robot motion planning considers both the dependencies among all the elements in the workspace and the potential influence of future movements of human workers. We experimentally validate the proposed planning framework using a 6-degree-of-freedom manipulator in a shared workspace where a human is performing disassembling tasks. The results demonstrate the benefits of our approach in terms of improving the smoothness and safety of HRC. A brief video introduction of this work is available as the supplemental materials.
引用
收藏
页码:3128 / 3136
页数:9
相关论文
共 50 条
  • [21] Conformal Prediction for Uncertainty-Aware Planning with Diffusion Dynamics Model
    Sun, Jiankai
    Jiang, Yiqi
    Qiu, Jianing
    Nobel, Parth Talpur
    Kochenderfer, Mykel
    Schwager, Mac
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [22] Graph-based Motion Planning with Primitives in a Continuous State Space Search
    Pedrosa, Matheus V. A.
    Schneider, Tristan
    Flasskamp, Kathrin
    2021 6TH INTERNATIONAL CONFERENCE ON MECHANICAL ENGINEERING AND ROBOTICS RESEARCH (ICMERR), 2021, : 30 - +
  • [23] Region and graph-based motion segmentation
    Monteiro, Fernando C.
    Campilho, Aurelio
    IMAGE ANALYSIS AND RECOGNITION, PROCEEDINGS, 2008, 5112 : 609 - 618
  • [24] Graph-based representation learning for automatic human motion segmentation
    Li, Meng
    Leung, Howard
    MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (15) : 9205 - 9224
  • [25] Graph-based Normalizing Flow for Human Motion Generation and Reconstruction
    Yin, Wenjie
    Yin, Hang
    Kragic, Danica
    Bjorkman, Marten
    2021 30TH IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (RO-MAN), 2021, : 641 - 648
  • [26] Graph-based representation learning for automatic human motion segmentation
    Meng Li
    Howard Leung
    Multimedia Tools and Applications, 2016, 75 : 9205 - 9224
  • [27] Adaptive risk tendency in uncertainty-aware motion planning using risk-sensitive Reinforcement Learning
    Wang, Zhidong
    Wei, Chongfeng
    Tang, Xiaolin
    Zhao, Wanzhong
    Hu, Chuan
    Zhang, Xi
    ADVANCED ENGINEERING INFORMATICS, 2025, 63
  • [28] Evaluation of Differentially Constrained Motion Models for Graph-Based Trajectory Prediction
    Westny, Theodor
    Oskarsson, Joel
    Olofsson, Bjorn
    Frisk, Erik
    2023 IEEE INTELLIGENT VEHICLES SYMPOSIUM, IV, 2023,
  • [29] Uncertainty-aware prediction of chemical reaction yields with graph neural networks
    Youngchun Kwon
    Dongseon Lee
    Youn-Suk Choi
    Seokho Kang
    Journal of Cheminformatics, 14
  • [30] Uncertainty-aware prediction of chemical reaction yields with graph neural networks
    Kwon, Youngchun
    Lee, Dongseon
    Choi, Youn-Suk
    Kang, Seokho
    JOURNAL OF CHEMINFORMATICS, 2022, 14 (01)