Depth image super resolution via semi self-taught learning framework

被引:2
|
作者
Zhao, Furong [1 ]
Cao, Zhiguo [1 ]
Xiao, Yang [1 ]
Zhang, Xiaodi [1 ]
Xian, Ke [1 ]
Li, Ruibo [1 ]
机构
[1] Huazhong Univ Sci & Technol, Natl Key Lab Sci & Technol Multispectral Informat, Wuhan, Hubei, Peoples R China
基金
国家高技术研究发展计划(863计划);
关键词
Depth image; super resolution; random forests; cascade; SUPERRESOLUTION;
D O I
10.1117/12.2270079
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Depth images have recently attracted much attention in computer vision and high-quality 3D content for 3DTV and 3D movies. In this paper, we present a new semi self-taught learning application framework for enhancing resolution of depth maps without making use of ancillary color images data at the target resolution, or multiple aligned depth maps. Our framework consists of cascade random forests reaching from coarse to fine results. We learn the surface information and structure transformations both from a small high-quality depth exemplars and the input depth map itself across different scales. Considering that edge plays an important role in depth map quality, we optimize an effective regularized objective that calculates on output image space and input edge space in random forests. Experiments show the effectiveness and superiority of our method against other techniques with or without applying aligned RGB information.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Deep Self-Taught Learning for Weakly Supervised Object Localization
    Jie, Zequn
    Wei, Yunchao
    Jin, Xiaojie
    Feng, Jiashi
    Liu, Wei
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 4294 - 4302
  • [22] High level feature extraction for the self-taught learning algorithm
    Markov, Konstantin
    Matsui, Tomoko
    EURASIP JOURNAL ON AUDIO SPEECH AND MUSIC PROCESSING, 2013,
  • [23] Domain Adaptive Self-Taught Learning for Heterogeneous Face Recognition
    Hou, Cheng-An
    Yang, Min-Chun
    Wang, Yu-Chiang Frank
    2014 22ND INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2014, : 3068 - 3073
  • [24] Self-Taught Low-Rank Coding for Visual Learning
    Li, Sheng
    Li, Kang
    Fu, Yun
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (03) : 645 - 656
  • [25] Exponential Family Sparse Coding with Applications to Self-taught Learning
    Lee, Honglak
    Raina, Rajat
    Teichman, Alex
    Ng, Andrew Y.
    21ST INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI-09), PROCEEDINGS, 2009, : 1113 - 1119
  • [26] Learning Style Identification Using Semisupervised Self-Taught Labeling
    Ayyoub, Hani Y.
    Al-Kadi, Omar S.
    IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, 2024, 17 : 1093 - 1106
  • [27] High level feature extraction for the self-taught learning algorithm
    Konstantin Markov
    Tomoko Matsui
    EURASIP Journal on Audio, Speech, and Music Processing, 2013
  • [28] ACTIVE LEARNING APPROACHES TO TRAINING - ENCOURAGING THE SELF-TAUGHT USER
    BOGUE, EL
    ACM SIGUCCS USER SERVICES CONFERENCE XVII: SIGUCCS 89 - CAPITALIZING ON COMMUNICATION, 1989, : 447 - 452
  • [29] Self-taught learning of a deep invariant representation for visual tracking via temporal slowness principle
    Kuen, Jason
    Lim, Kian Ming
    Lee, Chin Poo
    PATTERN RECOGNITION, 2015, 48 (10) : 2964 - 2982
  • [30] Scalable Self-taught Deep-Embedded Learning Framework for Drug Abuse Spatial Behaviors Detection
    Liu, Wuji
    Ye, Xinyue
    Phan, Hai
    Hu, Han
    COMPUTATIONAL DATA AND SOCIAL NETWORKS, 2019, 11917 : 223 - 228