Context and Intention aware 3D Human Body Motion Prediction using an Attention Deep Learning model in Handover Tasks

被引:3
|
作者
Laplaza, Javier [1 ]
Moreno-Noguer, Francesc [1 ]
Sanfeliu, Alberto [1 ]
机构
[1] Inst Robot & Informat Ind Barcelona IRI, Catalonia, Spain
基金
欧盟地平线“2020”;
关键词
D O I
10.1109/IROS47612.2022.9981465
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work explores how contextual information and human intention affect the motion prediction of humans during a handover operation with a social robot. By classifying human intention in four different classes, we developed a model able to generate a different motion for each intention class. Furthermore, the model uses a multi-headed attention architecture to add contextual information to the pipeline, such as the position of the robot end effector (REE) or the position of obstacles in the interaction scene. We generate predictions up to two and half seconds in the future given an input sequence of one second containing the previous motion of the human. The results show an improvement of the prediction accuracy, both for the full skeleton prediction and the human hand used for the delivery. The model also allows to generate different sequences with the desired human intention.
引用
下载
收藏
页码:4743 / 4748
页数:6
相关论文
共 50 条
  • [1] Context and Intention for 3D Human Motion Prediction: Experimentation and User study in Handover Tasks
    Laplaza, Javier
    Garrell, Anais
    Moreno-Noguer, Francesc
    Sanfeliu, Alberto
    2022 31ST IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (IEEE RO-MAN 2022), 2022, : 630 - 635
  • [2] Attention deep learning based model for predicting the 3D Human Body Pose using the Robot Human Handover Phases
    Laplaza, Javier
    Pumarola, Albert
    Moreno-Noguer, Francesc
    Sanfeliu, Alberto
    2021 30TH IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (RO-MAN), 2021, : 161 - 166
  • [3] Context-Aware Deep Learning Model for 3D Human Motion Prediction in Human-Robot Collaborative Construction
    Liang, Xiaoyun
    Sheng, Lin
    Cai, Jiannan
    Li, Shuai
    Shi, Yangming
    COMPUTING IN CIVIL ENGINEERING 2023-DATA, SENSING, AND ANALYTICS, 2024, : 479 - 487
  • [4] Context Attention: Human Motion Prediction Using Context Information and Deep Learning Attention Models
    Laplaza, Javier
    Moreno-Noguer, Francesc
    Sanfeliu, Alberto
    ROBOT2022: FIFTH IBERIAN ROBOTICS CONFERENCE: ADVANCES IN ROBOTICS, VOL 1, 2023, 589 : 102 - 112
  • [5] Intention-Aware Motion Planning Using Learning Based Human Motion Prediction
    Park, Jae Sung
    Park, Chonhyon
    Manocha, Dinesh
    ROBOTICS: SCIENCE AND SYSTEMS XIII, 2017,
  • [6] Deep learning-based activity-aware 3D human motion trajectory prediction in construction
    Heravi, Moein Younesi
    Jang, Youjin
    Jeong, Inbae
    Sarkar, Sajib
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 239
  • [7] A dual attention model based on probabilistically mask for 3D human motion prediction
    Cao, Wenming
    Li, Shuangshuang
    Zhong, Jianqi
    NEUROCOMPUTING, 2022, 493 : 106 - 118
  • [8] Learning Human Motion Intention with 3D Convolutional Neural Network
    Owoyemi, Joshua
    Hashimoto, Koichi
    2017 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (ICMA), 2017, : 1810 - 1815
  • [9] Learning Dynamic Relationships for 3D Human Motion Prediction
    Cui, Qiongjie
    Sun, Huaijiang
    Yang, Fei
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 6518 - 6526
  • [10] Learning spectral transform for 3D human motion prediction
    Kim, Boeun
    Choi, Jin Young
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2022, 223