Human pose estimation for low-resolution image using 1-D heatmaps and offset regression

被引:4
|
作者
Chi, Cailong [1 ]
Zhang, Dong [1 ]
Zhu, Zhesi [1 ]
Wang, Xingzhi [1 ]
Lee, Dah-Jye [2 ]
机构
[1] Sun Yat Sen Univ, Sch Elect & Informat Technol, Guangzhou 510006, Guangdong, Peoples R China
[2] Brigham Young Univ, Dept Elect & Comp Engn, Provo, UT 84602 USA
基金
中国国家自然科学基金;
关键词
Human pose estimation; Heatmap-based regression; 1-D heatmap; Offset regression; RECOMMENDATION SYSTEM;
D O I
10.1007/s11042-022-13468-w
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Running a reliable network on resource-limited platforms for a low-resolution image is a great challenge for heatmap-based human pose estimation (HPE). Scale mismatch between the input image and heatmaps and the intrinsic quantization effect induced by the 'argmax' function hinder the performance of heatmap-based human pose estimation for low-resolution image. In this paper, we propose a coordinate-decoupled and offset-revised module (CDORM) to tackle these challenges. The proposed CDORM uses two coordinate-decoupled 1-D heatmaps to supervise the regression process of determining the horizontal and vertical locations of human joints, and employs offset regressing to alleviate the effect of quantization. The CDORM can be integrated with any current heatmap-based HPE network without increasing the size of network significantly. Experimental results on the COCO and MPII datasets show that CDORM helps heatmap-based regression approaches obtain high estimation accuracy from the low-resolution image and only slightly increases the size and runtime of the network.
引用
收藏
页码:6289 / 6307
页数:19
相关论文
共 50 条
  • [1] Human pose estimation for low-resolution image using 1-D heatmaps and offset regression
    Cailong Chi
    Dong Zhang
    Zhesi Zhu
    Xingzhi Wang
    Dah-Jye Lee
    [J]. Multimedia Tools and Applications, 2023, 82 : 6289 - 6307
  • [2] Low-resolution human pose estimation
    Wang, Chen
    Zhang, Feng
    Zhu, Xiatian
    Ge, Shuzhi Sam
    [J]. PATTERN RECOGNITION, 2022, 126
  • [3] Human Pose Estimation Using Skeletal Heatmaps
    Jun, Jinyoung
    Lee, Jae-Han
    Kim, Chang-Su
    [J]. 2020 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2020, : 1287 - 1292
  • [4] Regression-based 3D Hand Pose Estimation using Heatmaps
    Bandi, Chaitanya
    Thomas, Ulrike
    [J]. PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 5: VISAPP, 2020, : 636 - 643
  • [5] Stable 3D Human Pose Estimation in Low-Resolution Videos with a Few Views
    Nakatsuka, Chihiro
    Komorita, Satoshi
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022,
  • [6] Multi-resolution Fusion Network for Human Pose Estimation in Low-resolution Images
    Kim, Boeun
    Choo, YeonSeung
    Jeong, Hea In
    Kim, Chung-Il
    Shin, Saim
    Kim, Jungho
    [J]. KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2022, 16 (07) : 2328 - 2344
  • [7] LFIR2Pose: Pose Estimation from an Extremely Low-resolution FIR image Sequence
    Iwata, Saki
    Kawanishi, Yasutomo
    Deguchi, Daisuke
    Ide, Ichiro
    Murase, Hiroshi
    Aizawa, Tomoyoshi
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 2597 - 2603
  • [8] Human Pose Estimation on Privacy-Preserving Low-Resolution Depth Images
    Srivastav, Vinkle
    Gangi, Afshin
    Padoy, Nicolas
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT V, 2019, 11768 : 583 - 591
  • [9] On High-Resolution Image Estimation using Low-Resolution Brain MRI
    Rousseau, Francois
    Gounot, Daniel
    Studholme, Colin
    [J]. 2013 35TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2013, : 1081 - 1084
  • [10] 3D Human Pose Estimation with 2D Marginal Heatmaps
    Nibali, Aiden
    He, Zhen
    Morgan, Stuart
    Prendergast, Luke
    [J]. 2019 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2019, : 1477 - 1485