3D Pose Regression using Convolutional Neural Networks

被引:70
|
作者
Mahendran, Siddharth [1 ]
Ali, Haider [1 ]
Vidal, Rene [1 ]
机构
[1] Johns Hopkins Univ, Ctr Imaging Sci, Baltimore, MD 21218 USA
基金
美国国家科学基金会;
关键词
D O I
10.1109/ICCVW.2017.254
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D pose estimation is a key component of many important computer vision tasks such as autonomous navigation and 3D scene understanding. Most state-of-the-art approaches to 3D pose estimation solve this problem as a pose-classification problem in which the pose space is discretized into bins and a CNN classifier is used to predict a pose bin. We argue that the 3D pose space is continuous and propose to solve the pose estimation problem in a CNN regression framework with a suitable representation, data augmentation and loss function that captures the geometry of the pose space. Experiments on PASCAL3D+ show that the proposed 3D pose regression approach achieves competitive performance compared to the state-of-the-art.
引用
下载
收藏
页码:2174 / 2182
页数:9
相关论文
共 50 条
  • [21] 3D Head Pose Estimation through Facial Features and Deep Convolutional Neural Networks
    Khan, Khalil
    Ali, Jehad
    Ahmad, Kashif
    Gul, Asma
    Sarwar, Ghulam
    Khan, Sahib
    Ta, Qui Thanh Hoai
    Chung, Tae-Sun
    Attique, Muhammad
    CMC-COMPUTERS MATERIALS & CONTINUA, 2021, 66 (02): : 1757 - 1770
  • [22] 3D Hand Pose Estimation with Neural Networks
    Antonio Serra, Jose
    Garcia-Rodriguez, Jose
    Orts-Escolano, Sergio
    Manuel Garcia-Chamizo, Juan
    Angelopoulou, Anastassia
    Psarrou, Alexandra
    Mentzelopoulos, Markos
    Montoyo-Bojo, Javier
    Dominguez, Enrique
    ADVANCES IN COMPUTATIONAL INTELLIGENCE, PT II, 2013, 7903 : 504 - +
  • [23] 3D Object Classification using 3D Racah Moments Convolutional Neural Networks
    Mesbah, Abderrahim
    Berrahou, Aissam
    El Alami, Abdelmajid
    Berrahou, Nadia
    Berbia, Hassan
    Qjidaa, Hassan
    PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON NETWORKING, INFORMATION SYSTEMS & SECURITY (NISS19), 2019,
  • [24] Accelerating 3D Convolutional Neural Networks Using 3D Fast Fourier Transform
    Fang, Chao
    He, Liulu
    Wang, Haonan
    Wei, Jinghe
    Wang, Zhongfeng
    2021 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2021,
  • [25] Cephalometric Landmark Regression with Convolutional Neural Networks on 3D Computed Tomography Data
    Lachinov, D.
    Getmanskaya, A.
    Turlapov, V
    PATTERN RECOGNITION AND IMAGE ANALYSIS, 2020, 30 (03) : 512 - 522
  • [26] Cephalometric Landmark Regression with Convolutional Neural Networks on 3D Computed Tomography Data
    D. Lachinov
    A. Getmanskaya
    V. Turlapov
    Pattern Recognition and Image Analysis, 2020, 30 : 512 - 522
  • [27] 3D object understanding with 3D Convolutional Neural Networks
    Leng, Biao
    Liu, Yu
    Yu, Kai
    Zhang, Xiangyang
    Xiong, Zhang
    INFORMATION SCIENCES, 2016, 366 : 188 - 201
  • [28] 3D Hand Pose Estimation Using Semantic Dynamic Hypergraph Convolutional Networks
    Wu, Yalei
    Li, Jinghua
    Kong, Dehui
    Li, Qianxing
    Yin, Baocai
    Journal of Shanghai Jiaotong University (Science), 2024,
  • [29] Segmentation of tomography datasets using 3D convolutional neural networks
    James, Jim
    Pruyne, Nathan
    Stan, Tiberiu
    Schwarting, Marcus
    Yeom, Jiwon
    Hong, Seungbum
    Voorhees, Peter
    Blaiszik, Ben
    Foster, Ian
    COMPUTATIONAL MATERIALS SCIENCE, 2023, 216
  • [30] Solar Flare Forecast Using 3D Convolutional Neural Networks
    Sun, Pengchao
    Dai, Wei
    Ding, Weiqi
    Feng, Song
    Cui, Yanmei
    Liang, Bo
    Dong, Zeyin
    Yang, Yunfei
    ASTROPHYSICAL JOURNAL, 2022, 941 (01):