Improving robustness for pose estimation via stable heatmap regression

被引:5
|
作者
Zhang, Yumeng [1 ]
Chen, Li [1 ]
Liu, Yufeng [2 ]
Guo, Xiaoyan [3 ]
Zheng, Wen [3 ]
Yong, Junhai [1 ]
机构
[1] Tsinghua Univ, Sch Software, BNRist, Beijing, Peoples R China
[2] Southeast Univ, Inst Brain & Intelligence, SEU ALLEN Joint Ctr, Nanjing, Peoples R China
[3] Kuaishou Technol, Beijing, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Pose estimation; Robustness; Heatmap regression; Deep learning; Stability training;
D O I
10.1016/j.neucom.2022.04.046
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning methods have achieved excellent performance in pose estimation, but the lack of robustness causes the keypoints to change drastically between similar images. In view of this problem, a stable heatmap regression method is proposed to alleviate network vulnerability to small perturbations. We utilize the correlation between different rows and columns in a heatmap to alleviate the multi-peaks problem, and design a highly differentiated heatmap regression to make a keypoint discriminative from surrounding points. A maximum stability training loss is used to simplify the optimization difficulty when minimizing the prediction gap of two similar images. The proposed method achieves a significant advance in robustness over state-of-the-art approaches on four benchmark datasets and maintains high performance. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:322 / 342
页数:21
相关论文
共 50 条
  • [41] Deep convolutional neural network-based Bernoulli heatmap for head pose estimation
    Hu, Zhongxu
    Xing, Yang
    Lv, Chen
    Hang, Peng
    Liu, Jie
    NEUROCOMPUTING, 2021, 436 : 198 - 209
  • [42] Adaptive module and accurate heatmap translator for multi-person human pose estimation
    Qi, Yongfeng
    Zhang, Hengrui
    Wen, Shengcong
    Liang, Anye
    Cao, Panpan
    Chen, Huili
    COMPUTERS & GRAPHICS-UK, 2024, 120
  • [43] HEMlets Pose: Learning Part-Centric Heatmap Triplets for Accurate 3D Human Pose Estimation
    Zhou, Kun
    Han, Xiaoguang
    Jiang, Nianjuan
    Jia, Kui
    Lu, Jiangbo
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 2344 - 2353
  • [44] Heterogeneous heatmap distillation framework based on unbiased alignment for lightweight human pose estimation
    Du, Congju
    Li, Zhenyu
    Zhao, Huijuan
    He, Shuangjiang
    Yu, Li
    IMAGE AND VISION COMPUTING, 2024, 146
  • [45] On the Robustness of 3D Human Pose Estimation
    Chen, Zerui
    Huang, Yan
    Wang, Liang
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 5326 - 5332
  • [46] Increasing robustness in self-localization and pose estimation
    Micheals, RJ
    Boult, TE
    MOBILE ROBOTS XIV, 1999, 3838 : 99 - 113
  • [47] A comparative study of the robustness of two pose estimation techniques
    Madsen, CB
    MACHINE VISION AND APPLICATIONS, 1997, 9 (5-6) : 291 - 303
  • [48] A comparative study of the robustness of two pose estimation techniques
    Claus B. Madsen
    Machine Vision and Applications, 1997, 9 : 291 - 303
  • [49] Adaptive Wing Loss for Robust Face Alignment via Heatmap Regression
    Wang, Xinyao
    Bo, Liefeng
    Li Fuxin
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6970 - 6980
  • [50] Head pose Estimation via Direction-sensitive Feature and Random Regression Forests
    Liu, Jianming
    Zeng, Jiguo
    COMPUTER AND INFORMATION TECHNOLOGY, 2014, 519-520 : 693 - 702