Three-Dimensional Human Hand Pose Estimation Based on Finger-Point Reinforcement and Multi-Level Feature Fusion

被引:2
|
作者
Zhang Kaiyi [1 ,2 ]
Hong Ru [1 ,2 ]
Gai Shaoyan [1 ,2 ]
Da Feipeng [1 ,2 ,3 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing 210096, Jiangsu, Peoples R China
[2] Southeast Univ, Minist Educ, Key Lab Measurement & Control Complex Engn Syst, Nanjing 210096, Jiangsu, Peoples R China
[3] Southeast Univ, Shenzhen Res Inst, Shenzhen 518036, Guangdong, Peoples R China
关键词
machine vision; three-dimensional point cloud; deep learning; attention mechanism; hand pose estimation; 3D HAND; REGRESSION;
D O I
10.3788/AOS202242.1915001
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
The existing three-dimensional (3D) human hand pose estimation algorithms do not fully exploit the characteristics of fingers and the key features. To solve this problem, a finger-point reinforcement (FPR) strategy and a multi-layer fusion squeeze and excitation (MFSE) block are proposed. The FPR strategy highlights the role of the finger position points in the human hand point cloud, strengthens the attention of network feature extraction layers to the finger position points in the point cloud, and improves the regression accuracy of the finger joint points. The MFSE block improves the ability of the layered network to extract and express local features. This module realizes the fusion and weight distribution of different levels of features between the layered networks, thereby enhancing the robustness of the model and the accuracy of human hand pose estimation. Experiments on two public benchmark datasets, MSRA and ICVL, verify that the proposed algorithm can achieve high-precision 3D human hand pose estimation.
引用
收藏
页数:8
相关论文
共 26 条
  • [1] Real-Time Gesture Recognition Based on Kinect
    Bao Zhiqiang
    Lu Chengang
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (03)
  • [2] Active Learning for Bayesian 3D Hand Pose Estimation
    Caramalau, Razvan
    Bhattarai, Binod
    Kim, Tae-Kyun
    [J]. 2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 3418 - 3427
  • [3] Pose guided structured region ensemble network for cascaded hand pose estimation
    Chen, Xinghao
    Wang, Guijin
    Guo, Hengkai
    Zhang, Cairong
    [J]. NEUROCOMPUTING, 2020, 395 (395) : 138 - 149
  • [4] SHPR-Net: Deep Semantic Hand Pose Regression From Point Clouds
    Chen, Xinghao
    Wang, Guijin
    Zhang, Cairong
    Kim, Tae-Kyun
    Ji, Xiangyang
    [J]. IEEE ACCESS, 2018, 6 : 43425 - 43439
  • [5] SO-HandNet: Self-Organizing Network for 3D Hand Pose Estimation with Semi-supervised Learning
    Chen, Yujin
    Tu, Zhigang
    Ge, Liuhao
    Zhang, Dejun
    Chen, Ruizhi
    Yuan, Junsong
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6960 - 6969
  • [6] Pose Invariant Face Recognition Using Maximum Gabor Similarity Based on Lucas-Kanade Algorithm
    Cheng Chao
    Da Feipeng
    Wang Chenxing
    Jiang Changjin
    [J]. ACTA OPTICA SINICA, 2019, 39 (07)
  • [7] Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis
    Dai, Angela
    Qi, Charles Ruizhongtai
    Niessner, Matthias
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 6545 - 6554
  • [8] A CNN model for real time hand pose estimation*
    Ding, Lu
    Wang, Yong
    Laganiere, Robert
    Huang, Dan
    Fu, Shan
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 79
  • [9] Point-to-Point Regression PointNet for 3D Hand Pose Estimation
    Ge, Liuhao
    Ren, Zhou
    Yuan, Junsong
    [J]. COMPUTER VISION - ECCV 2018, PT XIII, 2018, 11217 : 489 - 505
  • [10] Hand PointNet: 3D Hand Pose Estimation using Point Sets
    Ge, Liuhao
    Cai, Yujun
    Weng, Junwu
    Yuan, Junsong
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8417 - 8426