Improving robustness for pose estimation via stable heatmap regression

被引:5
|
作者
Zhang, Yumeng [1 ]
Chen, Li [1 ]
Liu, Yufeng [2 ]
Guo, Xiaoyan [3 ]
Zheng, Wen [3 ]
Yong, Junhai [1 ]
机构
[1] Tsinghua Univ, Sch Software, BNRist, Beijing, Peoples R China
[2] Southeast Univ, Inst Brain & Intelligence, SEU ALLEN Joint Ctr, Nanjing, Peoples R China
[3] Kuaishou Technol, Beijing, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Pose estimation; Robustness; Heatmap regression; Deep learning; Stability training;
D O I
10.1016/j.neucom.2022.04.046
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning methods have achieved excellent performance in pose estimation, but the lack of robustness causes the keypoints to change drastically between similar images. In view of this problem, a stable heatmap regression method is proposed to alleviate network vulnerability to small perturbations. We utilize the correlation between different rows and columns in a heatmap to alleviate the multi-peaks problem, and design a highly differentiated heatmap regression to make a keypoint discriminative from surrounding points. A maximum stability training loss is used to simplify the optimization difficulty when minimizing the prediction gap of two similar images. The proposed method achieves a significant advance in robustness over state-of-the-art approaches on four benchmark datasets and maintains high performance. (c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:322 / 342
页数:21
相关论文
共 50 条
  • [11] Improving Robustness and Accuracy via Relative Information Encoding in 3D Human Pose Estimation
    Shan, Wenkang
    Lu, Haopeng
    Wang, Shanshe
    Zhang, Xinfeng
    Gao, Wen
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3446 - 3454
  • [12] Heatmap Regression via Randomized Rounding
    Yu, Baosheng
    Tao, Dacheng
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (11) : 8276 - 8289
  • [13] Scale-aware heatmap representation for human pose estimation
    Yu, Han
    Du, Congju
    Yu, Li
    PATTERN RECOGNITION LETTERS, 2022, 154 : 1 - 6
  • [14] More accurate heatmap generation method for human pose estimation
    Qi, Yongfeng
    Zhang, Hengrui
    Liu, Jia
    MULTIMEDIA SYSTEMS, 2024, 30 (04)
  • [15] Skeleton-aware Multi-scale Heatmap Regression for 2D Hand Pose Estimation
    Kourbane, Ikram
    Genc, Yakup
    Informatica (Slovenia), 2021, 45 (04): : 593 - 604
  • [16] Skeleton-aware Multi-scale Heatmap Regression for 2D Hand Pose Estimation
    Kourbane, Ikram
    Genc, Yakup
    INFORMATICA-AN INTERNATIONAL JOURNAL OF COMPUTING AND INFORMATICS, 2021, 45 (04): : 593 - 604
  • [17] Improving Adversarial Robustness via Mutual Information Estimation
    Zhou, Dawei
    Wang, Nannan
    Gao, Xinbo
    Han, Bo
    Wang, Xiaoyu
    Zhan, Yibing
    Liu, Tongliang
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [18] Vehicle pose estimation via regression of semantic points of interest
    Garcia Lopez, Javier
    Agudo, Antonio
    Moreno-Noguer, Francesc
    PROCEEDINGS OF THE 2019 11TH INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS (ISPA 2019), 2019, : 209 - 214
  • [19] 6D Pose Estimation based on High-Resolution Heatmap Regression for Virtual and Reality Fusion Interaction
    Yang, Xinyan
    Ma, Ying
    Sun, Feiran
    Yang, Yinghao
    Ye, Long
    JOURNAL OF IMAGING SCIENCE AND TECHNOLOGY, 2025, 69 (01)
  • [20] Lightweight Human Pose Estimation Based on Heatmap Weighted Loss Function
    Wang, Xin
    Li, Guanhua
    Chen, Yongfeng
    Wen, Ge
    ENGINEERING LETTERS, 2024, 32 (11) : 2127 - 2137