Improving robustness for pose estimation via stable heatmap regression

被引:5
|
作者
Zhang, Yumeng [1 ]
Chen, Li [1 ]
Liu, Yufeng [2 ]
Guo, Xiaoyan [3 ]
Zheng, Wen [3 ]
Yong, Junhai [1 ]
机构
[1] Tsinghua Univ, Sch Software, BNRist, Beijing, Peoples R China
[2] Southeast Univ, Inst Brain & Intelligence, SEU ALLEN Joint Ctr, Nanjing, Peoples R China
[3] Kuaishou Technol, Beijing, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Pose estimation; Robustness; Heatmap regression; Deep learning; Stability training;
D O I
10.1016/j.neucom.2022.04.046
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning methods have achieved excellent performance in pose estimation, but the lack of robustness causes the keypoints to change drastically between similar images. In view of this problem, a stable heatmap regression method is proposed to alleviate network vulnerability to small perturbations. We utilize the correlation between different rows and columns in a heatmap to alleviate the multi-peaks problem, and design a highly differentiated heatmap regression to make a keypoint discriminative from surrounding points. A maximum stability training loss is used to simplify the optimization difficulty when minimizing the prediction gap of two similar images. The proposed method achieves a significant advance in robustness over state-of-the-art approaches on four benchmark datasets and maintains high performance. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:322 / 342
页数:21
相关论文
共 50 条
  • [31] Belief Modeling Regression for pose estimation
    Cuzzolin, Fabio
    Gong, Wenjuan
    2013 16TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2013, : 1398 - 1405
  • [32] Head Pose Estimation: Classification or Regression?
    Guo, Guodong
    Fu, Yun
    Dyer, Charles R.
    Huang, Thomas S.
    19TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOLS 1-6, 2008, : 567 - +
  • [33] Bottom-Up Human Pose Estimation Via Disentangled Keypoint Regression
    Geng, Zigang
    Sun, Ke
    Xiao, Bin
    Zhang, Zhaoxiang
    Wang, Jingdong
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 14671 - 14681
  • [34] Constrained kernel regression for pose estimation
    Zhang, Haopeng
    Jiang, Zhiguo
    ELECTRONICS LETTERS, 2014, 50 (02) : 77 - 78
  • [35] POSE ESTIMATION BY LOCAL PROCRUSTES REGRESSION
    Raytchev, Bisser
    Terakado, Kazuya
    Tamaki, Toru
    Kaneda, Kazufumi
    2011 18TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2011,
  • [36] A Transfer Learning Approach to Heatmap Regression for Action Unit Intensity Estimation
    Ntinou, Ioanna
    Sanchez, Enrique
    Bulat, Adrian
    Valstar, Michel
    Tzimiropoulos, Georgios
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (01) : 436 - 450
  • [37] Boosting integral-based human pose estimation through implicit heatmap learning
    Du, Congju
    Yan, Zengqiang
    Xiong, Zixiang
    Yu, Li
    NEURAL NETWORKS, 2024, 179
  • [38] Stable Hand Pose Estimation under Tremor via Graph Neural Network
    Leng, Zhiying
    Chen, Jiaying
    Shum, Hubert P. H.
    Li, Frederick W. B.
    Liang, Xiaohui
    2021 IEEE VIRTUAL REALITY AND 3D USER INTERFACES (VR), 2021, : 226 - 234
  • [39] AHRNET: ATTENTION AND HEATMAP-BASED REGRESSOR FOR HAND POSE ESTIMATION AND MESH RECOVERY
    Zhou, Feng
    Shen, Pei
    Dai, Ju
    Jiang, Na
    Hu, Yong
    Lai, Yu-Kun
    Rosin, Paul L.
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 3000 - 3004
  • [40] Light and Fast Hand Pose Estimation From Spatial-Decomposed Latent Heatmap
    Liu, Shaowei
    Wang, Guijin
    Xie, Pengwei
    Zhang, Cairong
    IEEE ACCESS, 2020, 8 : 53072 - 53081