Causal Intervention Learning for Multi-person Pose Estimation

被引:0
|
作者
Yue, Luhui
Li, Junxia
Liu, Qingshan [1 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Sch Automat, B DAT, Nanjing 210044, Peoples R China
来源
关键词
Multi-person pose estimation; Structure Causal Model; Biased decision; Causal intervention; NETWORK;
D O I
10.1007/978-3-031-02375-0_14
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most of learning targets for multi-person pose estimation are based on the likelihood P(Y vertical bar X). However, if we construct the causal assumption for keypoints, named a Structure Causal Model (SCM) for the causality, P(Y vertical bar X) will introduce the bias via spurious correlations in the SCM. In practice, it appears as that networks may make biased decisions in the dense area of keypoints. Therefore, we propose a novel learning method, named Causal Intervention pose Network (ClposeNet). Causal intervention is a learning method towards solving bias in the SCM of keypoints. Specifically, under the consideration of causal inference, ClposeNet is developed based on the backdoor adjustment and the learning target will change into causal intervention P(Y vertical bar do(X)) instead of the likelihood P(Y vertical bar X). The experiments conducted on multi-person datasets show that ClposeNet indeed releases bias in the networks.
引用
收藏
页码:182 / 194
页数:13
相关论文
共 50 条
  • [1] Pose Knowledge Transfer for multi-person pose estimation
    Buwei Li
    Yi Ji
    Ying Li
    Yunlong Xu
    Chunping Liu
    [J]. Signal, Image and Video Processing, 2022, 16 : 321 - 328
  • [2] Pose Partition Networks for Multi-person Pose Estimation
    Nie, Xuecheng
    Feng, Jiashi
    Xing, Junliang
    Yan, Shuicheng
    [J]. COMPUTER VISION - ECCV 2018, PT V, 2018, 11209 : 705 - 720
  • [3] Pose Knowledge Transfer for multi-person pose estimation
    Li, Buwei
    Ji, Yi
    Li, Ying
    Xu, Yunlong
    Liu, Chunping
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (02) : 321 - 328
  • [4] Monocular multi-person pose estimation: A survey
    dos Reis, Eduardo Souza
    Seewald, Lucas Adams
    Antunes, Rodolfo Stoffel
    Rodrigues, Vinicius Facco
    Righi, Rodrigo da Rosa
    da Costa, Cristiano Andre
    da Silveira Jr, Luiz Gonzaga
    Eskofier, Bjoern
    Maier, Andreas
    Horz, Tim
    Fahrig, Rebecca
    [J]. PATTERN RECOGNITION, 2021, 118
  • [5] RMPE: Regional Multi-Person Pose Estimation
    Fang, Hao-Shu
    Xie, Shuqin
    Tai, Yu-Wing
    Lu, Cewu
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2353 - 2362
  • [6] Multi-Person Pose Estimation on Embedded Device
    Ma, Zhipeng
    Tian, Dawei
    Zhang, Ming
    He, Dingxin
    [J]. 2020 INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND HUMAN-COMPUTER INTERACTION (ICHCI 2020), 2020, : 57 - 61
  • [7] The Overview of Multi-person Pose Estimation Method
    Li, Bingyi
    Zou, Jiaqi
    Wang, Luyao
    Li, Xiangyuan
    Li, Yue
    Lei, Rongjia
    Sun, Songlin
    [J]. SIGNAL AND INFORMATION PROCESSING, NETWORKING AND COMPUTERS (ICSINC), 2019, 550 : 600 - 607
  • [8] Cluster-wise learning network for multi-person pose estimation
    Zhao, Ying
    Luo, Zhiwei
    Quan, Changqin
    Liu, Dianchao
    Wang, Gang
    [J]. PATTERN RECOGNITION, 2020, 98
  • [9] Multi-Domain Pose Network for Multi-Person Pose Estimation and Tracking
    Guo, Hengkai
    Tang, Tang
    Luo, Guozhong
    Chen, Riwei
    Lu, Yongchen
    Wen, Linfu
    [J]. COMPUTER VISION - ECCV 2018 WORKSHOPS, PT II, 2019, 11130 : 209 - 216
  • [10] Lite Hourglass Network for Multi-person Pose Estimation
    Zhao, Ying
    Luo, Zhiwei
    Quan, Changqin
    Liu, Dianchao
    Wang, Gang
    [J]. MULTIMEDIA MODELING (MMM 2020), PT II, 2020, 11962 : 226 - 238