Depth image super resolution via semi self-taught learning framework

被引:2
|
作者
Zhao, Furong [1 ]
Cao, Zhiguo [1 ]
Xiao, Yang [1 ]
Zhang, Xiaodi [1 ]
Xian, Ke [1 ]
Li, Ruibo [1 ]
机构
[1] Huazhong Univ Sci & Technol, Natl Key Lab Sci & Technol Multispectral Informat, Wuhan, Hubei, Peoples R China
基金
国家高技术研究发展计划(863计划);
关键词
Depth image; super resolution; random forests; cascade; SUPERRESOLUTION;
D O I
10.1117/12.2270079
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Depth images have recently attracted much attention in computer vision and high-quality 3D content for 3DTV and 3D movies. In this paper, we present a new semi self-taught learning application framework for enhancing resolution of depth maps without making use of ancillary color images data at the target resolution, or multiple aligned depth maps. Our framework consists of cascade random forests reaching from coarse to fine results. We learn the surface information and structure transformations both from a small high-quality depth exemplars and the input depth map itself across different scales. Considering that edge plays an important role in depth map quality, we optimize an effective regularized objective that calculates on output image space and input edge space in random forests. Experiments show the effectiveness and superiority of our method against other techniques with or without applying aligned RGB information.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Depth image super-resolution via multi-frame registration and deep learning
    Tseng, Ching Wei
    Su, Hong-Ren
    Lai, Shang-Hong
    Liu, JenChi
    2016 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA), 2016,
  • [32] Image super-resolution via adaptive sparse representation and self-learning
    Zhao, Jianwei
    Sun, Tiantian
    Cao, Feilong
    IET COMPUTER VISION, 2018, 12 (05) : 753 - 761
  • [33] Image Super-Resolution via Local Self-Learning Manifold Approximation
    1600, Institute of Electrical and Electronics Engineers Inc., United States (21):
  • [34] Deep and Self-taught Learning for Protein Accessible Surface Area Prediction
    ul Hassan, Fahad
    Minhas, Fayyaz ul Amir Afsar
    2017 INTERNATIONAL CONFERENCE ON FRONTIERS OF INFORMATION TECHNOLOGY (FIT), 2017, : 264 - 269
  • [35] Social network analysis of self-taught e-learning communities
    Laghos, Andrew
    Zaphiris, Panayiotis
    INTERNATIONAL JOURNAL OF KNOWLEDGE AND LEARNING, 2007, 3 (4-5) : 465 - 482
  • [36] Analysis for Self-taught and Transfer Learning Based Approaches for Emotion Recognition
    Bhandari, Piyush
    Bijarniya, Rakesh Kumar
    Chatterjee, Subhamoy
    Kolekar, Maheshkumar
    2018 5TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND INTEGRATED NETWORKS (SPIN), 2018, : 509 - 512
  • [37] Zola Self-taught: genesis of works and learning of the writer in naturalist regime
    White, Claire
    MODERN LANGUAGE REVIEW, 2015, 110 : 549 - 550
  • [38] EPITHELIUM-STROMA CLASSIFICATION IN HISTOPATHOLOGICAL IMAGES VIA CONVOLUTIONAL NEURAL NETWORKS AND SELF-TAUGHT LEARNING
    Huang, Yue
    Zheng, Han
    Liu, Chi
    Rohde, Gustavo
    Zeng, Delu
    Wang, Jiaqi
    Ding, Xinghao
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 1073 - 1077
  • [39] A Novel Approach For Finger Vein Verification Based on Self-Taught Learning
    Fayyaz, Mohsen
    Hajizadeh-Saffar, Mohammad
    Sabokrou, Mohammad
    Hoseini, Mojtaba
    Fathy, Mahmood
    2015 9TH IRANIAN CONFERENCE ON MACHINE VISION AND IMAGE PROCESSING (MVIP), 2015, : 88 - 91
  • [40] SINGLE DEPTH IMAGE SUPER RESOLUTION VIA A DUAL SPARSITY MODEL
    Zhang, Yulun
    Zhang, Yongbing
    Dai, Qionghai
    2015 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2015,