3D Pose Regression using Convolutional Neural Networks

被引:70
|
作者
Mahendran, Siddharth [1 ]
Ali, Haider [1 ]
Vidal, Rene [1 ]
机构
[1] Johns Hopkins Univ, Ctr Imaging Sci, Baltimore, MD 21218 USA
基金
美国国家科学基金会;
关键词
D O I
10.1109/ICCVW.2017.254
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D pose estimation is a key component of many important computer vision tasks such as autonomous navigation and 3D scene understanding. Most state-of-the-art approaches to 3D pose estimation solve this problem as a pose-classification problem in which the pose space is discretized into bins and a CNN classifier is used to predict a pose bin. We argue that the 3D pose space is continuous and propose to solve the pose estimation problem in a CNN regression framework with a suitable representation, data augmentation and loss function that captures the geometry of the pose space. Experiments on PASCAL3D+ show that the proposed 3D pose regression approach achieves competitive performance compared to the state-of-the-art.
引用
下载
收藏
页码:2174 / 2182
页数:9
相关论文
共 50 条
  • [1] 3D Pose Regression using Convolutional Neural Networks
    Mahendran, Siddharth
    Ali, Haider
    Vidal, Rene
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 494 - 495
  • [2] Pose prediction using 3D deep convolutional neural networks
    Wallach, Izhar
    Dzamba, Michael
    Schrodl, Stefan
    Rampasek, Ladislav
    ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 2017, 254
  • [3] Semantic Graph Convolutional Networks for 3D Human Pose Regression
    Zhao, Long
    Peng, Xi
    Tian, Yu
    Kapadia, Mubbasir
    Metaxas, Dimitris N.
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3420 - 3430
  • [4] 3D Human Pose Estimation Using Convolutional Neural Networks with 2D Pose Information
    Park, Sungheon
    Hwang, Jihye
    Kwak, Nojun
    COMPUTER VISION - ECCV 2016 WORKSHOPS, PT III, 2016, 9915 : 156 - 169
  • [5] 3D HUMAN POSE REGRESSION USING GRAPH CONVOLUTIONAL NETWORK
    Banik, Soubarna
    García, Alejandro Mendoza
    Knoll, Alois
    arXiv, 2021,
  • [6] 3D HUMAN POSE REGRESSION USING GRAPH CONVOLUTIONAL NETWORK
    Banik, Soubarna
    GarcIa, Alejandro Mendoza
    Knoll, Alois
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 924 - 928
  • [7] Sparse Representation and Convolutional Neural Networks for 3D Human Pose Estimation
    Alikarami, Hassan
    Yaghmaee, Farzin
    Fadaeieslam, Mohammad Javad
    2017 3RD IRANIAN CONFERENCE ON SIGNAL PROCESSING AND INTELLIGENT SYSTEMS (ICSPIS), 2017, : 188 - 192
  • [8] Real-Time 3D Hand Pose Estimation with 3D Convolutional Neural Networks
    Ge, Liuhao
    Liang, Hui
    Yuan, Junsong
    Thalmann, Daniel
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (04) : 956 - 970
  • [9] Multi-person 3D pose estimation from 3D cloud data using 3D convolutional neural networks
    Vasileiadis, Manolis
    Bouganis, Christos-Savvas
    Tzovaras, Dimitrios
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 185 : 12 - 23
  • [10] LipsID Using 3D Convolutional Neural Networks
    Hlavac, Miroslav
    Gruber, Ivan
    Zelezny, Milos
    Karpov, Alexey
    SPEECH AND COMPUTER (SPECOM 2018), 2018, 11096 : 209 - 214