3D Skeleton-Based Non-Autoregressive Human Motion Prediction Using Encoder-Decoder Attention-Based Model

被引:0
|
作者
Lovanshi, Mayank [1 ]
Tiwari, Vivek [2 ]
Ingle, Rajesh [1 ]
Jain, Swati [3 ]
机构
[1] Int Inst Informat Technol, Dept CSE, Atal Nagar Nava Raipur 493661, India
[2] ABV Indian Inst Informat Technol & Management ABV, Dept CSE, Gwalior 474015, India
[3] Govt J Yoganandam Chhattisgarh Coll, Raipur 492001, India
关键词
Transformers; Predictive models; Decoding; Data models; Vectors; Training; Task analysis; Non-autoregressive; encoder-decoder attention; motion transformer; spatiotemporal attention; human skeleton; human motion prediction;
D O I
10.1109/TETCI.2024.3418828
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
An encoder-decoder attention-based model has been employed to predict human action using a 3D skeleton-based human activity dataset. It offers and advocates a non-autoregressive approach to leverage human motion prediction effectively. The encoder framework employs a spatiotemporal attention mechanism to capture spatiotemporal features. While the decoder uses a motion attention mechanism to predict human motion. An extensive experiment has been carried out with two datasets, Human3.6 M and AMASS, to validate the performance of the proposed model. The proposed model outperforms the best available SOTA methods on H3.6 M by 13.63%, 14.28%, 19.14%, and 12.87% with 80 ms, 160 ms, 320 ms, and 400 ms, respectively, in terms of average Euler angle error. Similar results are observed with the AMASS dataset. The proposed model predicts human motion more accurately than the previous best methods by 2.44%, 1%, 1.25% and 1.3% in terms of Euler angle error, joint angle error, positional error, & percentage of correct key point, respectively. Furthermore, a separate discussion has been carried out to analyse the effect of autoregressive & non-autoregressive approaches for human motion prediction.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Attention-Based Encoder-Decoder Model for Photovoltaic Power Generation Prediction
    Zhu, Xiang
    Hu, Juntao
    Song, Liangcai
    Suo, Guilong
    Zhan, Yong
    5TH ANNUAL INTERNATIONAL CONFERENCE ON INFORMATION SYSTEM AND ARTIFICIAL INTELLIGENCE (ISAI2020), 2020, 1575
  • [2] Arabic Machine Transliteration using an Attention-based Encoder-decoder Model
    Ameur, Mohamed Seghir Hadj
    Meziane, Farid
    Guessoum, Ahmed
    ARABIC COMPUTATIONAL LINGUISTICS (ACLING 2017), 2017, 117 : 287 - 297
  • [3] Mining Implicit Intention Using Attention-Based RNN Encoder-Decoder Model
    Li, ChenXing
    Du, YaJun
    Wang, SiDa
    INTELLIGENT COMPUTING METHODOLOGIES, ICIC 2017, PT III, 2017, 10363 : 413 - 424
  • [4] Attention-Based Encoder-Decoder Network for Prediction of Electromagnetic Scattering Fields
    Zhang, Ying
    He, Mang
    2022 IEEE 10TH ASIA-PACIFIC CONFERENCE ON ANTENNAS AND PROPAGATION, APCAP, 2022,
  • [5] Attention-Based Personalized Encoder-Decoder Model for Local Citation Recommendation
    Yang, Libin
    Zhang, Zeqing
    Cai, Xiaoyan
    Dai, Tao
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2019, 2019
  • [6] Attention-based encoder-decoder model for answer selection in question answering
    Yuan-ping Nie
    Yi Han
    Jiu-ming Huang
    Bo Jiao
    Ai-ping Li
    Frontiers of Information Technology & Electronic Engineering, 2017, 18 : 535 - 544
  • [7] Attention-based encoder-decoder model for answer selection in question answering
    Nie, Yuan-ping
    Han, Yi
    Huang, Jiu-ming
    Jiao, Bo
    Li, Ai-ping
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2017, 18 (04) : 535 - 544
  • [8] Describing Multimedia Content Using Attention-Based Encoder-Decoder Networks
    Cho, Kyunghyun
    Courville, Aaron
    Bengio, Yoshua
    IEEE TRANSACTIONS ON MULTIMEDIA, 2015, 17 (11) : 1875 - 1886
  • [9] Accurate water quality prediction with attention-based bidirectional LSTM and encoder-decoder
    Bi, Jing
    Chen, Zexian
    Yuan, Haitao
    Zhang, Jia
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [10] Enhancing lane changing trajectory prediction on highways: A heuristic attention-based encoder-decoder model
    Xiao, Xue
    Bo, Peng
    Chen, Yingda
    Chen, Yili
    Li, Keping
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2024, 639