Low-resolution human pose estimation

被引:12
|
作者
Wang, Chen [1 ]
Zhang, Feng [2 ]
Zhu, Xiatian [3 ]
Ge, Shuzhi Sam [4 ]
机构
[1] Univ Elect Sci & Technol China, Sch Comp Sci & Engn, Chengdu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Sch Comp Sci & Technol, Nanjing, Peoples R China
[3] Univ Surrey, Fac Engn & Phys Sci, Ctr Vis Speech & Signal Proc, Guildford GU2 7XH, Surrey, England
[4] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore, Singapore
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Human pose estimation; Low resolution image; Heatmap learning; Offset learning; Quantization error;
D O I
10.1016/j.patcog.2022.108579
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Human pose estimation has achieved significant progress on images with high imaging resolution. However, low-resolution imagery data bring nontrivial challenges which are still under-studied. To fill this gap, we start with investigating existing methods and reveal that the most dominant heatmap-based methods would suffer more severe model performance degradation from low-resolution, and offset learning is an effective strategy. Established on this observation, in this work we propose a novel Confidence-Aware Learning (CAL) method which further addresses two fundamental limitations of existing offset learning methods: inconsistent training and testing, decoupled heatmap and offset learning. Specifically, CAL selectively weighs the learning of heatmap and offset with respect to ground-truth and most confident prediction, whilst capturing the statistical importance of model output in mini-batch learning manner. Extensive experiments conducted on the COCO benchmark show that our method outperforms significantly the state-of-the-art methods for low-resolution human pose estimation. (c) 2022 Elsevier Ltd. All rights reserved.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Multi-resolution Fusion Network for Human Pose Estimation in Low-resolution Images
    Kim, Boeun
    Choo, YeonSeung
    Jeong, Hea In
    Kim, Chung-Il
    Shin, Saim
    Kim, Jungho
    [J]. KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2022, 16 (07) : 2328 - 2344
  • [2] Human Pose Estimation on Privacy-Preserving Low-Resolution Depth Images
    Srivastav, Vinkle
    Gangi, Afshin
    Padoy, Nicolas
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT V, 2019, 11768 : 583 - 591
  • [3] Mobile-LRPose: Low-Resolution Representation Learning for Human Pose Estimation in Mobile Devices
    Nan, Xinyu
    Wang, Chenxing
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT V, 2024, 14429 : 211 - 224
  • [4] Stable 3D Human Pose Estimation in Low-Resolution Videos with a Few Views
    Nakatsuka, Chihiro
    Komorita, Satoshi
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022,
  • [5] Free-Head Pose Estimation under Low-Resolution Scenarios
    Liu, Jingjing
    Wang, Zhiyong
    Qin, Haibo
    Xu, Kai
    Ji, Bin
    Liu, Honghai
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 2277 - 2283
  • [6] Joint Super-Resolution and Head Pose Estimation for Extreme Low-Resolution Faces
    Malakshan, Sahar Rahimi
    Saadabadi, Mohammad Saeed Ebrahimi
    Mostofa, Moktari
    Soleymani, Sobhan
    Nasrabadi, Nasser M.
    [J]. IEEE ACCESS, 2023, 11 : 11238 - 11253
  • [7] Human pose estimation for low-resolution image using 1-D heatmaps and offset regression
    Cailong Chi
    Dong Zhang
    Zhesi Zhu
    Xingzhi Wang
    Dah-Jye Lee
    [J]. Multimedia Tools and Applications, 2023, 82 : 6289 - 6307
  • [8] Human pose estimation for low-resolution image using 1-D heatmaps and offset regression
    Chi, Cailong
    Zhang, Dong
    Zhu, Zhesi
    Wang, Xingzhi
    Lee, Dah-Jye
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (04) : 6289 - 6307
  • [9] LFIR2Pose: Pose Estimation from an Extremely Low-resolution FIR image Sequence
    Iwata, Saki
    Kawanishi, Yasutomo
    Deguchi, Daisuke
    Ide, Ichiro
    Murase, Hiroshi
    Aizawa, Tomoyoshi
    [J]. 2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 2597 - 2603
  • [10] ANN for human pose estimation in low resolution depth images
    Szczuko, Piotr
    [J]. 2017 SIGNAL PROCESSING: ALGORITHMS, ARCHITECTURES, ARRANGEMENTS, AND APPLICATIONS (SPA 2017), 2017, : 354 - 359