LGCANet: lightweight hand pose estimation network based on HRNet

被引:0
|
作者
Pan, Xiaoying [1 ,2 ]
Li, Shoukun [1 ,2 ]
Wang, Hao [3 ,4 ]
Wang, Beibei [1 ,2 ]
Wang, Haoyi [5 ]
机构
[1] Xian Univ Posts & Telecommun, Sch Comp Sci & Technol, Xian 710121, Shaanxi, Peoples R China
[2] Xian Univ Posts & Telecommun, Shaanxi Key Lab Network Data Anal & Intelligent Pr, Xian 710121, Shaanxi, Peoples R China
[3] Northwestern Polytech Univ, Sch Software, Xian 710072, Shaanxi, Peoples R China
[4] Northwestern Polytech Univ, Natl Engn Lab Air Earth Sea Integrat Big Data Appl, Xian 710121, Shaanxi, Peoples R China
[5] Southwest Univ, Westa Coll, Chongqing, Peoples R China
来源
JOURNAL OF SUPERCOMPUTING | 2024年 / 80卷 / 13期
关键词
Hand pose estimation; High-resolution network; Multi-scale feature fusion; Lightweight network;
D O I
10.1007/s11227-024-06226-2
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Hand pose estimation is a fundamental task in computer vision with applications in virtual reality, gesture recognition, autonomous driving, and virtual surgery. Keypoint detection often relies on deep learning methods and high-resolution feature map representations to achieve accurate detection. The HRNet framework serves as the basis, but it presents challenges in terms of extensive parameter count and demanding computational complexity due to high-resolution representations. To mitigate these challenges, we propose a lightweight keypoint detection network called LGCANet (Lightweight Ghost-Coordinate Attention Network). This network primarily consists of a lightweight feature extraction head for initial feature extraction and multiple lightweight foundational network modules called GCAblocks. GCAblocks introduce linear transformations to generate redundant feature maps while concurrently considering inter-channel relationships and long-range positional information using a coordinate attention mechanism. Validation on the RHD dataset and the COCO-WholeBody-Hand dataset shows that LGCANet reduces the number of parameters by 65.9% and GFLOPs by 72.6% while preserving the accuracy and improves the detection speed.
引用
收藏
页码:19351 / 19373
页数:23
相关论文
共 50 条
  • [1] Lightweight Human Pose Estimation Network Based on HRNet
    Liang Q.
    Wu Y.
    [J]. Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2023, 50 (02): : 112 - 121
  • [2] Lightweight HRNet: A Ligtweight Network for Bottom-Up Human Pose Estimation
    Liao, Jinzhen
    Cui, Wenhua
    Tao, Ye
    Shi, Tianwei
    Shen, Lijia
    [J]. ENGINEERING LETTERS, 2024, 32 (03) : 661 - 670
  • [3] Human Pose Estimation Based on Efficient and Lightweight High-Resolution Network (EL-HRNet)
    Li, Rui
    Yan, An
    Yang, Shiqiang
    He, Duo
    Zeng, Xin
    Liu, Hongyan
    [J]. SENSORS, 2024, 24 (02)
  • [4] A-HRNet: Attention Based High Resolution Network for Human pose estimation
    Li, Ying
    Wang, Chenxi
    Cao, Yu
    Liu, Benyuan
    Luo, Yan
    Zhang, Honggang
    [J]. 2020 SECOND INTERNATIONAL CONFERENCE ON TRANSDISCIPLINARY AI (TRANSAI 2020), 2020, : 75 - 79
  • [5] EDite-HRNet: Enhanced Dynamic Lightweight High-Resolution Network for Human Pose Estimation
    Rui, Liyuheng
    Gao, Yanyan
    Ren, Haopan
    [J]. IEEE ACCESS, 2023, 11 : 95948 - 95957
  • [6] LiteHandNet: A Lightweight Hand Pose Estimation Network via Structural Feature Enhancement
    Huang, Zhi-Yong
    Chen, Song-Lu
    Liu, Qi
    Zhang, Chong-Jian
    Chen, Feng
    Yin, Xu-Cheng
    [J]. MULTIMEDIA MODELING, MMM 2023, PT I, 2023, 13833 : 321 - 333
  • [7] Hand pose estimation based on improved NSRM network
    Yang, Shiqiang
    He, Duo
    Li, Qi
    Wang, Jinhua
    Li, Dexin
    [J]. EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2023, 2023 (01)
  • [8] Hand pose estimation based on improved NSRM network
    Shiqiang Yang
    Duo He
    Qi Li
    Jinhua Wang
    Dexin Li
    [J]. EURASIP Journal on Advances in Signal Processing, 2023
  • [9] Lite CSW-HRNet: Lightweight High-Resolution Human Pose Estimation Based on Channel Spatial Weighting
    Xi, Yang
    Zhang, Zi-Hao
    Meng, Si-Yu
    Fu, Jia
    Wu, Zhen-Yu
    Wang, Wen-Jing
    [J]. Journal of Network Intelligence, 2024, 9 (03): : 1641 - 1656
  • [10] SCite-HRNet: A self-calibrating efficient network for pose estimation
    Xiang, Nan
    Rao, Xingdi
    Yang, Wenjing
    Chen, Jin
    Zhu, Lifang
    [J]. Electronics Letters, 2024, 60 (23)