JS']JSL3D: Joint subspace learning with implicit structure supervision for 3D pose estimation

被引:4
|
作者
Jiang, Mengxi [1 ,2 ]
Zhou, Shihao [2 ]
Li, Cuihua [2 ]
Lei, Yunqi [2 ]
机构
[1] Fuzhou Univ, Sch Adv Mfg, Jinjiang 362251, Peoples R China
[2] Xiamen Univ, Dept Comp Sci, Xiamen 361005, Peoples R China
关键词
3D pose estimation; Sparse representation model; Implicit structure supervision; Joint subspace learning; SPARSE REPRESENTATION;
D O I
10.1016/j.patcog.2022.108965
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Estimating 3D human poses from a single image is an important task in computer graphics. Most model -based estimation methods represent the labeled/detected 2D poses and the projection of approximated 3D poses using vector representations of body joints. However, such lower-dimensional vector representa-tions fail to maintain the spatial relations of original body joints, because the representations do not con-sider the inherent structure of body joints. In this paper, we propose JSL3D , a novel joint subspace learn-ing approach with implicit structure supervision based on Sparse Representation (SR) model, capturing the latent spatial relations of 2D body joints by an end-to-end autoencoder network. JSL3D jointly com-bines the learned latent spatial relations and 2D joints as inputs for the standard SR inference frame. The optimization is simultaneously processed via geometric priors in both latent and original feature spaces. We have evaluated JSL3D using four large-scale and well-recognized benchmarks, including Human3.6M , HumanEva-I , CMU MoCap and MPII . The experiment results demonstrate the effectiveness of JSL3D .(c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] 3D human pose estimation base on weighted joint loss
    Wang, Chao
    Zhang, Chun
    Wang, Jinghao
    Fan, Tianyu
    Xie, Xiang
    [J]. PROCEEDINGS OF 2021 2ND INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND INFORMATION SYSTEMS (ICAIIS '21), 2021,
  • [22] 3D Human Pose Estimation Based on Volumetric Joint Coordinates
    Wan, Yunchong
    Song, Yunpeng
    Liu, Ligang
    [J]. Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (09): : 1411 - 1419
  • [23] Modeling Static and Dynamic Joint Relationship for 3D Pose Estimation
    Liu, Qiong
    He, Jianhang
    Wen, Jiaxiao
    [J]. Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2024, 47 (05): : 35 - 43
  • [24] Body Structure Constraint For 3D Human Pose Estimation
    Liu, Zhifang
    Luo, Chunshui
    Gao, Yihua
    Wang, Haoqian
    Huang, Xiang
    [J]. 2023 2ND CONFERENCE ON FULLY ACTUATED SYSTEM THEORY AND APPLICATIONS, CFASTA, 2023, : 654 - 658
  • [25] Optimizing Network Structure for 3D Human Pose Estimation
    Ci, Hai
    Wang, Chunyu
    Ma, Xiaoxuan
    Wang, Yizhou
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 2262 - 2271
  • [26] 3D Human Pose Estimation With Spatial Structure Information
    Huang, Xiaoshan
    Huang, Jun
    Tang, Zengming
    [J]. IEEE ACCESS, 2021, 9 : 35947 - 35956
  • [27] Propagating LSTM: 3D Pose Estimation Based on Joint Interdependency
    Lee, Kyoungoh
    Lee, Inwoong
    Lee, Sanghoon
    [J]. COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 : 123 - 141
  • [28] Learning Joint Twist Rotation for 3D Human Pose Estimation from a Single Image
    Nakatsuka, Chihiro
    Xu, Jianfeng
    Tasaka, Kazuyuki
    [J]. VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 5: VISAPP, 2021, : 379 - 386
  • [29] Learning Single-View 3D Reconstruction with Limited Pose Supervision
    Yang, Guandao
    Cui, Yin
    Belongie, Serge
    Hariharan, Bharath
    [J]. COMPUTER VISION - ECCV 2018, PT 15, 2018, 11219 : 90 - 105
  • [30] 3D Keypoint Estimation Using Implicit Representation Learning
    Zhu, Xiangyu
    Du, Dong
    Huang, Haibin
    Ma, Chongyang
    Han, Xiaoguang
    [J]. COMPUTER GRAPHICS FORUM, 2023, 42 (05)