LFSimCC: Spatial fusion lightweight network for human pose estimation

被引:0
|
作者
Zheng, Qian [1 ]
Guo, Hualing [1 ]
Yin, Yunhua [2 ]
Zheng, Bin [1 ]
Jiang, Hongxu [1 ]
机构
[1] North Univ China, Sch Elect & Control Engn, Taiyuan 030051, Peoples R China
[2] Sci & Technol Transient Impact Lab, Beijing 102202, Peoples R China
关键词
Lightweight model SimCC Self attention mechanism Spatial information fusion;
D O I
10.1016/j.jvcir.2024.104093
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To address the limitations of existing 2D human pose estimation methods in terms of speed and lightweight, we propose a method called Lightweight Fusion SimCC (LFSimCC). LFSimCC incorporates two modules: LiteFNet, which enhances multi-scale spatial information fusion, and LKC-GAU, which improves the modeling capability of spatial information. Specifically, LiteFNet utilizes a combination of self -attention mechanism and novel spatial convolution to enable feature maps to capture richer multi-level global feature representations within the network. On the other hand, LKC-GAU enhances SimCC's ability to capture spatial relationships between joints by incorporating a large kernel of convolution and a self -attention mechanism. Furthermore, we design a keypoint information fusion loss (IFL) that enhances the model's sensitivity to information between keypoints in the human body. Experimental results demonstrate that our method is capable of extracting more decisive information and suppressing redundant feature representations, leading to high recognition accuracy and low inference latency.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Lightweight Cross-Fusion Network on Human Pose Estimation for Edge Device
    Zhu, Xian
    Zeng, Xiaoqin
    Ma, Wei
    [J]. IEEE ACCESS, 2023, 11 : 134899 - 134907
  • [2] LCFFNet: A Lightweight Cross-scale Feature Fusion Network for human pose estimation
    Zou, Xuelian
    Bi, Xiaojun
    [J]. Neural Networks, 2025, 183
  • [3] Lightweight Human Pose Estimation Network Based on HRNet
    Liang Q.
    Wu Y.
    [J]. Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2023, 50 (02): : 112 - 121
  • [4] Lightweight Stacked Hourglass Network for Human Pose Estimation
    Kim, Seung-Taek
    Lee, Hyo Jong
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (18):
  • [5] Human Pose Estimation via an Ultra-Lightweight Pose Distillation Network
    Zhang, Shihao
    Qiang, Baohua
    Yang, Xianyi
    Wei, Xuekai
    Chen, Ruidong
    Chen, Lirui
    [J]. ELECTRONICS, 2023, 12 (12)
  • [6] LSDNet: lightweight stochastic depth network for human pose estimation
    Zhang, Hengrui
    Qi, Yongfeng
    Chen, Huili
    Cao, Panpan
    Liang, Anye
    Wen, Shengcong
    [J]. VISUAL COMPUTER, 2024,
  • [7] Lightweight densely connected residual network for human pose estimation
    Yang, Lianping
    Qin, Yu
    Zhang, Xiangde
    [J]. JOURNAL OF REAL-TIME IMAGE PROCESSING, 2021, 18 (03) : 825 - 837
  • [8] Lightweight densely connected residual network for human pose estimation
    Lianping Yang
    Yu Qin
    Xiangde Zhang
    [J]. Journal of Real-Time Image Processing, 2021, 18 : 825 - 837
  • [9] LDNet: Lightweight dynamic convolution network for human pose estimation
    Xu, Dingning
    Zhang, Rong
    Guo, Lijun
    Feng, Cun
    Gao, Shangce
    [J]. ADVANCED ENGINEERING INFORMATICS, 2022, 54
  • [10] Lightweight Multi-Resolution Network for Human Pose Estimation
    Li, Pengxin
    Wang, Rong
    Zhang, Wenjing
    Liu, Yinuo
    Xu, Chenyue
    [J]. CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2024, 138 (03): : 2239 - 2255