Lightweight Cross-Fusion Network on Human Pose Estimation for Edge Device

被引:1
|
作者
Zhu, Xian [1 ]
Zeng, Xiaoqin [1 ,2 ]
Ma, Wei [3 ,4 ]
机构
[1] Hohai Univ, Coll Comp & Informat, Nanjing 210098, Peoples R China
[2] Nanjing Univ Sci & Technol, Zijin Coll, Dept Comp Sci, Nanjing 210046, Peoples R China
[3] Nanjing Univ, Dept Comp Sci & Technol, State Key Lab Novel Software Technol, Nanjing 210093, Peoples R China
[4] Nanjing Inst Tourism & Hospitality, Nanjing 211100, Peoples R China
关键词
Cross-fusion network; human pose estimation; lightweight;
D O I
10.1109/ACCESS.2021.3065574
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The deployment of human pose estimation on edge devices are essential task in computer vision. Due to memory and storage space limitations, it is difficult for edge devices to maintain implementing Convolutional Neural Networks, which deployed large-scale terminal platforms with abundant computing resources. This paper proposed novel Lightweight Cross-fusion Network on Human Pose Estimation with information sharing. Using state-of-the-art efficient neural architecture, and Ghost Net, as the backbone, which are gradually applying a cross-information fusion network for key points extraction in the baseline and strengthen phases. As a result, the computational cost significantly reduced, while maintaining feature confidence more accurate and predicting key points heatmaps more precisely. The network model entirely executed on edge devices, and extensive self-comparison experiments evaluated the architecture's effectiveness. The MS COCO 2017 dataset proved that the cross-fusion network is superior than other lightweight structures for pose estimation.
引用
收藏
页码:134899 / 134907
页数:9
相关论文
共 50 条
  • [1] CrossFuNet: RGB and Depth Cross-Fusion Network for Hand Pose Estimation
    Sun, Xiaojing
    Wang, Bin
    Huang, Longxiang
    Zhang, Qian
    Zhu, Sulei
    Ma, Yan
    [J]. SENSORS, 2021, 21 (18)
  • [2] LCFFNet: A Lightweight Cross-scale Feature Fusion Network for human pose estimation
    Zou, Xuelian
    Bi, Xiaojun
    [J]. Neural Networks, 2025, 183
  • [3] LFSimCC: Spatial fusion lightweight network for human pose estimation
    Zheng, Qian
    Guo, Hualing
    Yin, Yunhua
    Zheng, Bin
    Jiang, Hongxu
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 99
  • [4] Lightweight Human Pose Estimation Network Based on HRNet
    Liang Q.
    Wu Y.
    [J]. Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2023, 50 (02): : 112 - 121
  • [5] Lightweight Stacked Hourglass Network for Human Pose Estimation
    Kim, Seung-Taek
    Lee, Hyo Jong
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (18):
  • [6] Human Pose Estimation via an Ultra-Lightweight Pose Distillation Network
    Zhang, Shihao
    Qiang, Baohua
    Yang, Xianyi
    Wei, Xuekai
    Chen, Ruidong
    Chen, Lirui
    [J]. ELECTRONICS, 2023, 12 (12)
  • [7] LSDNet: lightweight stochastic depth network for human pose estimation
    Zhang, Hengrui
    Qi, Yongfeng
    Chen, Huili
    Cao, Panpan
    Liang, Anye
    Wen, Shengcong
    [J]. VISUAL COMPUTER, 2024,
  • [8] Lightweight densely connected residual network for human pose estimation
    Yang, Lianping
    Qin, Yu
    Zhang, Xiangde
    [J]. JOURNAL OF REAL-TIME IMAGE PROCESSING, 2021, 18 (03) : 825 - 837
  • [9] Lightweight densely connected residual network for human pose estimation
    Lianping Yang
    Yu Qin
    Xiangde Zhang
    [J]. Journal of Real-Time Image Processing, 2021, 18 : 825 - 837
  • [10] LDNet: Lightweight dynamic convolution network for human pose estimation
    Xu, Dingning
    Zhang, Rong
    Guo, Lijun
    Feng, Cun
    Gao, Shangce
    [J]. ADVANCED ENGINEERING INFORMATICS, 2022, 54