Depth image super resolution via semi self-taught learning framework

被引:2
|
作者
Zhao, Furong [1 ]
Cao, Zhiguo [1 ]
Xiao, Yang [1 ]
Zhang, Xiaodi [1 ]
Xian, Ke [1 ]
Li, Ruibo [1 ]
机构
[1] Huazhong Univ Sci & Technol, Natl Key Lab Sci & Technol Multispectral Informat, Wuhan, Hubei, Peoples R China
基金
国家高技术研究发展计划(863计划);
关键词
Depth image; super resolution; random forests; cascade; SUPERRESOLUTION;
D O I
10.1117/12.2270079
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Depth images have recently attracted much attention in computer vision and high-quality 3D content for 3DTV and 3D movies. In this paper, we present a new semi self-taught learning application framework for enhancing resolution of depth maps without making use of ancillary color images data at the target resolution, or multiple aligned depth maps. Our framework consists of cascade random forests reaching from coarse to fine results. We learn the surface information and structure transformations both from a small high-quality depth exemplars and the input depth map itself across different scales. Considering that edge plays an important role in depth map quality, we optimize an effective regularized objective that calculates on output image space and input edge space in random forests. Experiments show the effectiveness and superiority of our method against other techniques with or without applying aligned RGB information.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Self-Taught Feature Learning for Hyperspectral Image Classification
    Kemker, Ronald
    Kanan, Christopher
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (05): : 2693 - 2705
  • [2] Self-taught Recovery of Depth Data
    Yang, Pan
    Zhao, Haoran
    Qi, Lin
    Zhong, Guoqiang
    2015 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA), 2015, : 1270 - 1275
  • [3] Online Dictionary Self-taught Learning for Hyperspectral Image Classification
    Liu, Fengshuang
    Ma, Jiachen
    Zhao, Rongqiang
    Wang, Qiang
    2018 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE (I2MTC): DISCOVERING NEW HORIZONS IN INSTRUMENTATION AND MEASUREMENT, 2018, : 1933 - 1937
  • [4] Tensor Dictionary Self-Taught Learning Classification Method for Hyperspectral Image
    Liu, Fengshuang
    Fu, Jun
    Wang, Qiang
    Zhao, Rongqiang
    REMOTE SENSING, 2022, 14 (17)
  • [5] Deep Self-Taught Hashing for Image Retrieval
    Liu, Yu
    Song, Jingkuan
    Zhou, Ke
    Yan, Lingyu
    Liu, Li
    Zou, Fuhao
    Shao, Ling
    IEEE TRANSACTIONS ON CYBERNETICS, 2019, 49 (06) : 2229 - 2241
  • [6] Semi-Supervised Self-Taught Deep Learning for Finger Bones Segmentation
    Zhao, Ziyuan
    Zhang, Xiaoman
    Chen, Cen
    Li, Wei
    Peng, Songyou
    Wang, Jie
    Yang, Xulei
    Zhang, Le
    Zeng, Zeng
    2019 IEEE EMBS INTERNATIONAL CONFERENCE ON BIOMEDICAL & HEALTH INFORMATICS (BHI), 2019,
  • [7] Deep Self-taught Hashing for Image Retrieval
    Zhou, Ke
    Liu, Yu
    Song, Jinkuan
    Yan, Linyu
    Zou, Fuhao
    Shen, Fumin
    MM'15: PROCEEDINGS OF THE 2015 ACM MULTIMEDIA CONFERENCE, 2015, : 1215 - 1218
  • [8] Self-Taught Active Learning from Crowds
    Fang, Meng
    Zhu, Xingquan
    Li, Bin
    Ding, Wei
    Wu, Xindong
    12TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2012), 2012, : 858 - 863
  • [9] STAR: A Scalable Self-taught Learning Framework for Older Adults' Activity Recognition
    Ramamurthy, Sreenivasan Ramasamy
    Ghosh, Indrajeet
    Gangopadhyay, Aryya
    Galik, Elizabeth
    Roy, Nirmalya
    2021 IEEE INTERNATIONAL CONFERENCE ON SMART COMPUTING (SMARTCOMP 2021), 2021, : 121 - 128
  • [10] Self-Taught Metric Learning without Labels
    Kim, Sungyeon
    Kim, Dongwon
    Cho, Minsu
    Kwak, Suha
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 7421 - 7431