Lightweight Stacked Hourglass Network for Human Pose Estimation

被引:20
|
作者
Kim, Seung-Taek [1 ]
Lee, Hyo Jong [1 ]
机构
[1] Jeonbuk Natl Univ, Div Comp Sci & Engn, Jeonju 54896, South Korea
来源
APPLIED SCIENCES-BASEL | 2020年 / 10卷 / 18期
基金
新加坡国家研究基金会;
关键词
pose estimation; stacked hourglass network; deep learning; convolutional receptive field;
D O I
10.3390/app10186497
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Featured Application The proposed lightweight hourglass network can be applied as an alternative to existing methods that use the hourglass model as a backbone network. Human pose estimation is a problem that continues to be one of the greatest challenges in the field of computer vision. While the stacked structure of an hourglass network has enabled substantial progress in human pose estimation and key-point detection areas, it is largely used as a backbone network. However, it also requires a relatively large number of parameters and high computational capacity due to the characteristics of its stacked structure. Accordingly, the present work proposes a more lightweight version of the hourglass network, which also improves the human pose estimation performance. The new hourglass network architecture utilizes several additional skip connections, which improve performance with minimal modifications while still maintaining the number of parameters in the network. Additionally, the size of the convolutional receptive field has a decisive effect in learning to detect features of the full human body. Therefore, we propose a multidilated light residual block, which expands the convolutional receptive field while also reducing the computational load. The proposed residual block is also invariant in scale when using multiple dilations. The well-known MPII and LSP human pose datasets were used to evaluate the performance using the proposed method. A variety of experiments were conducted that confirm that our method is more efficient compared to current state-of-the-art hourglass weight-reduction methods.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Animal Pose Estimation Algorithm Based on the Lightweight Stacked Hourglass Network
    Zhang, Wenwen
    Xu, Yang
    Bai, Rui
    Li, Li
    [J]. IEEE ACCESS, 2023, 11 : 5314 - 5327
  • [2] Improving Human Pose Estimation Based on Stacked Hourglass Network
    Zou, Xuelian
    Bi, Xiaojun
    Yu, Changdong
    [J]. NEURAL PROCESSING LETTERS, 2023, 55 (07) : 9521 - 9544
  • [3] Improving Human Pose Estimation Based on Stacked Hourglass Network
    Xuelian Zou
    Xiaojun Bi
    Changdong Yu
    [J]. Neural Processing Letters, 2023, 55 : 9521 - 9544
  • [4] Stacked Hourglass Networks for Human Pose Estimation
    Newell, Alejandro
    Yang, Kaiyu
    Deng, Jia
    [J]. COMPUTER VISION - ECCV 2016, PT VIII, 2016, 9912 : 483 - 499
  • [5] Multipath affinage stacked—hourglass networks for human pose estimation
    Guoguang Hua
    Lihong Li
    Shiguang Liu
    [J]. Frontiers of Computer Science, 2020, 14
  • [6] A faster hourglass network for human pose estimation
    Lu, Fan
    Yang, Yan
    Zhao, Yabang
    [J]. DEVELOPMENTS OF ARTIFICIAL INTELLIGENCE TECHNOLOGIES IN COMPUTATION AND ROBOTICS, 2020, 12 : 685 - 692
  • [7] Multipath affinage stacked-hourglass networks for human pose estimation
    Hua, Guoguang
    Li, Lihong
    Liu, Shiguang
    [J]. FRONTIERS OF COMPUTER SCIENCE, 2020, 14 (04)
  • [8] Human Pose Estimation of Diver Based on Improved Stacked Hourglass Model
    Lei, Fei
    Yan, Junyou
    Wang, Xueli
    [J]. ICVIP 2019: PROCEEDINGS OF 2019 3RD INTERNATIONAL CONFERENCE ON VIDEO AND IMAGE PROCESSING, 2019, : 178 - 182
  • [9] A Feature Aggregation Hourglass Network for Human Pose Estimation
    Lu, Fan
    Yang, Yan
    [J]. 2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [10] Multi-Residual Module Stacked Hourglass Networks for Human Pose Estimation
    Wenxia Bao
    Yaping Yang
    Dong Liang
    Ming Zhu
    [J]. Journal of Beijing Institute of Technology, 2020, 29 (01) : 110 - 119