Improving robustness for pose estimation via stable heatmap regression

被引:5
|
作者
Zhang, Yumeng [1 ]
Chen, Li [1 ]
Liu, Yufeng [2 ]
Guo, Xiaoyan [3 ]
Zheng, Wen [3 ]
Yong, Junhai [1 ]
机构
[1] Tsinghua Univ, Sch Software, BNRist, Beijing, Peoples R China
[2] Southeast Univ, Inst Brain & Intelligence, SEU ALLEN Joint Ctr, Nanjing, Peoples R China
[3] Kuaishou Technol, Beijing, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Pose estimation; Robustness; Heatmap regression; Deep learning; Stability training;
D O I
10.1016/j.neucom.2022.04.046
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning methods have achieved excellent performance in pose estimation, but the lack of robustness causes the keypoints to change drastically between similar images. In view of this problem, a stable heatmap regression method is proposed to alleviate network vulnerability to small perturbations. We utilize the correlation between different rows and columns in a heatmap to alleviate the multi-peaks problem, and design a highly differentiated heatmap regression to make a keypoint discriminative from surrounding points. A maximum stability training loss is used to simplify the optimization difficulty when minimizing the prediction gap of two similar images. The proposed method achieves a significant advance in robustness over state-of-the-art approaches on four benchmark datasets and maintains high performance. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:322 / 342
页数:21
相关论文
共 50 条
  • [1] Human Pose Estimation via Convolutional Part Heatmap Regression
    Bulat, Adrian
    Tzimiropoulos, Georgios
    COMPUTER VISION - ECCV 2016, PT VII, 2016, 9911 : 717 - 732
  • [2] Hand Pose Estimation via Latent 2.5D Heatmap Regression
    Iqbal, Umar
    Molchanov, Pavlo
    Breuel, Thomas
    Gall, Juergen
    Kautz, Jan
    COMPUTER VISION - ECCV 2018, PT XI, 2018, 11215 : 125 - 143
  • [3] Boosting Human Pose Estimation via Heatmap Refinement
    Jiang, Ling
    Liu, Zhuocheng
    Li, Kaige
    Wu, Wei
    MULTIMEDIA MODELING, MMM 2025, PT I, 2025, 15520 : 153 - 167
  • [4] Rethinking the Heatmap Regression for Bottom-up Human Pose Estimation
    Luo, Zhengxiong
    Wang, Zhicheng
    Huang, Yan
    Wang, Liang
    Tan, Tieniu
    Zhou, Erjin
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 13259 - 13268
  • [5] Multi-Person Pose Estimation With Accurate Heatmap Regression and Greedy Association
    Li, Jia
    Wang, Meng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (08) : 5521 - 5535
  • [6] Hope: heatmap and offset for pose estimation
    Xiao, Jing
    Li, Haichao
    Qu, Guangzhuo
    Fujita, Hamido
    Cao, Yang
    Zhu, Jia
    Huang, Changqin
    JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 13 (6) : 2937 - 2949
  • [7] DistilPose: Tokenized Pose Regression with Heatmap Distillation
    Ye, Suhang
    Zhang, Yingyi
    Hu, Jie
    Cao, Liujuan
    Zhang, Shengchuan
    Shen, Lei
    Wang, Jun
    Ding, Shouhong
    Ji, Rongrong
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 2163 - 2172
  • [8] Hope: heatmap and offset for pose estimation
    Jing Xiao
    Haichao Li
    Guangzhuo Qu
    Hamido Fujita
    Yang Cao
    Jia Zhu
    Changqin Huang
    Journal of Ambient Intelligence and Humanized Computing, 2022, 13 : 2937 - 2949
  • [9] Heatmap Distribution Matching for Human Pose Estimation
    Qu, Haoxuan
    Xu, Li
    Cai, Yujun
    Foo, Lin Geng
    Liu, Jun
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [10] Error Compensation Heatmap Decoding for Human Pose Estimation
    Yang Feiyu
    Song Zhan
    Xiao Zhenzhong
    Mo Yaoyang
    Chen Yu
    Pan Zhe
    Zhang Min
    Zhang Yao
    Qian Beibei
    Jin Wu
    IEEE ACCESS, 2021, 9 : 114514 - 114522