Human pose regression by combining indirect part detection and contextual information

被引:113
|
作者
Luvizon, Diogo C. [1 ,2 ]
Labia, Hedi [1 ,3 ]
Picard, David [1 ,4 ]
机构
[1] Paris Seine Univ, CNRS, ENSEA, ETIS UMR 8051, F-95000 Cergy, France
[2] Samsung Res Inst, Adv Technol, Campinas, SP, Brazil
[3] Univ Paris Saclay, IBISC, Univ Ewy Val Essonne, Paris, France
[4] UPE, Ecole Ponts, UMR 8049, LIGM, Champs Sur Marne, France
来源
COMPUTERS & GRAPHICS-UK | 2019年 / 85卷
关键词
Human pose estimation; Neural nets; vision; PICTORIAL STRUCTURES;
D O I
10.1016/j.cag.2019.09.002
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this paper, we tackle the problem of human pose estimation from still images, which is a very active topic, specially due to its several applications, from image annotation to human-machine interface. We use the soft-argmax function to convert feature maps directly to body joint coordinates, resulting in a fully differentiable framework. Our method is able to learn heat maps representations indirectly, without additional steps of artificial ground truth generation. Consequently, contextual information can be included to the pose predictions in a seamless way. We evaluated our method on two challenging datasets, the Leeds Sports Poses (LSP) and the MPII Human Pose datasets, reaching the best performance among all the existing regression methods. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:15 / 22
页数:8
相关论文
共 50 条
  • [31] Skin Detection Based on Contextual Information
    Moradi, Bahareh
    Ezoji, Mehdi
    2015 2ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION AND IMAGE ANALYSIS (IPRIA), 2015,
  • [32] Visual Relationship Detection with Contextual Information
    Li, Yugang
    Wang, Yongbin
    Chen, Zhe
    Zhu, Yuting
    CMC-COMPUTERS MATERIALS & CONTINUA, 2020, 63 (03): : 1575 - 1589
  • [33] Contextual information in SAR target detection
    Blacknell, D
    IEE PROCEEDINGS-RADAR SONAR AND NAVIGATION, 2001, 148 (01) : 41 - 47
  • [34] Quantifying Contextual Information for Object Detection
    Zheng, Wei-Shi
    Gong, Shaogang
    Xiang, Tao
    2009 IEEE 12TH INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2009, : 932 - 939
  • [35] Visual relationship detection with contextual information
    Li Y.
    Wang Y.
    Chen Z.
    Zhu Y.
    Computers, Materials and Continua, 2020, 63 (03): : 1575 - 1589
  • [36] Combining Head Pose and Eye Location Information for Gaze Estimation
    Valenti, Roberto
    Sebe, Nicu
    Gevers, Theo
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (02) : 802 - 815
  • [37] Combining information in survey sampling by modified regression
    Singh, AC
    Coats, RH
    AMERICAN STATISTICAL ASSOCIATION - 1996 PROCEEDINGS OF THE SECTION ON SURVEY RESEARCH METHODS, VOLS I AND II, 1996, : 120 - 129
  • [38] Alternating Regression Forests for Object Detection and Pose Estimation
    Schulter, Samuel
    Leistner, Christian
    Wohlhart, Paul
    Roth, Peter M.
    Bischof, Horst
    2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 417 - 424
  • [39] LAR-Pose: Lightweight human pose estimation with adaptive regression loss
    Lou, Xudong
    Lin, Xin
    Zeng, Henan
    Zhu, Xiangxian
    NEUROCOMPUTING, 2025, 633
  • [40] Combining information from direct and indirect searches for WIMPs
    Bottino, A
    SOURCES AND DETECTION OF DARK MATTER AND DARK ENERGY IN THE UNIVERSE, 2001, : 349 - 362