Three-dimensional image-based human pose recovery with hypergraph regularized autoencoders

被引:2
|
作者
Hong, Chaoqun [1 ]
Yu, Jun [2 ,3 ]
You Jane [4 ]
Yu, Zhiwen [5 ]
Chen, Xuhui [1 ]
机构
[1] Xiamen Univ Technol, Sch Comp Sci & Informat Engn, Xiamen, Peoples R China
[2] Hangzhou Dianzi Univ, Sch Comp Sci & Technol, Hangzhou, Zhejiang, Peoples R China
[3] Hangzhou Dianzi Univ, Key Lab Complex Syst Modeling & Simulat, Minist Educ, Hangzhou, Zhejiang, Peoples R China
[4] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Hong Kong, Peoples R China
[5] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Guangdong, Peoples R China
基金
中国国家自然科学基金;
关键词
3D human pose recovery; Autoencoders; Manifold learning; Hypergraph; Patch alignment framework; RECOGNITION;
D O I
10.1007/s11042-016-3312-7
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Three-Dimensional image-based human pose recovery tries to retrieves 3D poses with 2D image. Therefore, one of the key problem is how to represent 2D images. However, semantic gap exists for current feature extractors, which limits recovery performance. In this paper, we propose a novel feature extractor with deep neural network. It is based on denoising autoencoders and improves previous autoencoders by adopting locality preserved restriction. To impose this restriction, we introduce manifold regularization with hypergraph learning. Hypergraph Laplacian matrix is constructed with patch alignment framework. In this way, an automatic feature extractor for images is achieved. Experimental results on three datasets show that the recovery error can be reduced by 10 % to 20 %, which demonstrates the effectiveness of the proposed method.
引用
收藏
页码:10919 / 10937
页数:19
相关论文
共 50 条
  • [1] Three-dimensional image-based human pose recovery with hypergraph regularized autoencoders
    Chaoqun Hong
    Jun Yu
    You Jane
    Zhiwen Yu
    Xuhui Chen
    Multimedia Tools and Applications, 2017, 76 : 10919 - 10937
  • [2] Hypergraph regularized autoencoder for image-based 3D human pose recovery
    Hong, Chaoqun
    Chen, Xuhui
    Wang, Xiaodong
    Tang, Chaohui
    SIGNAL PROCESSING, 2016, 124 : 132 - 140
  • [3] Image-Based Three-Dimensional Human Pose Recovery by Multiview Locality-Sensitive Sparse Retrieval
    Hong, Chaoqun
    Yu, Jun
    Tao, Dacheng
    Wang, Meng
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2015, 62 (06) : 3742 - 3751
  • [4] Hypergraph Regularized Autoencoder for 3D Human Pose Recovery
    Hong, Chaoqun
    Yu, Jun
    Jane, You
    Chen, Xuhui
    COMPUTER VISION, CCCV 2015, PT I, 2015, 546 : 66 - 75
  • [5] Coupled multiview autoencoders with locality sensitivity for three-dimensional human pose estimation
    Yu, Jialin
    Sun, Jifeng
    Luo, Shasha
    Duan, Bichao
    JOURNAL OF ELECTRONIC IMAGING, 2017, 26 (05)
  • [6] Three-dimensional human pose estimation based on video
    Yang B.
    Li H.
    Zeng H.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2019, 45 (12): : 2463 - 2469
  • [7] Image-based Simulation of the Three-dimensional Coronary Blood Flow
    Quatember, B.
    Mayr, M.
    Recheis, W.
    MODSIM 2007: INTERNATIONAL CONGRESS ON MODELLING AND SIMULATION: LAND, WATER AND ENVIRONMENTAL MANAGEMENT: INTEGRATED SYSTEMS FOR SUSTAINABILITY, 2007, : 427 - 433
  • [8] IMAGE-BASED THREE-DIMENSIONAL FREE VIEWPOINT VIDEO SYNTHESIS
    Aliprandi, Davide
    Piccinelli, Emiliano
    2009 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO, 2009, : 97 - 100
  • [9] Multispectral embedding-based deep neural network for three-dimensional human pose recovery
    Yu, Jialin
    Sun, Jifeng
    OPTICAL ENGINEERING, 2018, 57 (01)
  • [10] Improving image-based visual servoing with three-dimensional features
    Cervera, E
    del Pobil, AP
    Berry, F
    Martinet, P
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2003, 22 (10-11): : 821 - 839