Depth Estimation From a Single RGB Image Using Fine-Tuned Generative Adversarial Network

被引:7
|
作者
Ul Islam, Naeem [1 ]
Park, Jaebyung [1 ,2 ]
机构
[1] Jeonbuk Natl Univ, Core Res Inst Intelligent Robots, Jeonju 54896, South Korea
[2] Jeonbuk Natl Univ, Div Elect & Informat Engn, Jeonju 54896, South Korea
来源
IEEE ACCESS | 2021年 / 9卷 / 09期
基金
新加坡国家研究基金会;
关键词
Estimation; Generators; Training; Shape; Robots; Generative adversarial networks; Three-dimensional displays; Generative adversarial network; convolutional neural network; image translation; auto-encoders; TRANSLATION;
D O I
10.1109/ACCESS.2021.3060435
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Estimating the depth map from a single RGB image is important to understand the nature of the terrain in robot navigation and has attracted considerable attention in the past decade. The existing approaches can accurately estimate the depth from a single RGB image, considering a highly structured environment. The problem becomes more challenging when the terrain is highly dynamic. We propose a fine-tuned generative adversarial network to estimate the depth map effectively for a given single RGB image. The proposed network is composed of a fine-tuned generator and a global discriminator. The encoder part of the generator takes input RGB images and depth maps and generates their joint distribution in the latent space. Subsequently, the decoder part of the generator decodes the depth map from the joint distribution. The discriminator takes real and fake pairs in three different configurations and then guides the generator to estimate the depth map from the given RGB image accordingly. Finally, we conducted extensive experiments with a highly dynamic environment dataset for verifying the effectiveness and feasibility of the proposed approach. The proposed approach could decode the depth map from the joint distribution more effectively and accurately than the existing approaches.
引用
收藏
页码:32781 / 32794
页数:14
相关论文
共 50 条
  • [1] Generative adversarial networks for depth map estimation from RGB video
    Lore, Kin Gwn
    Reddy, Kishore
    Giering, Michael
    Bernal, Edgar A.
    [J]. PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, : 1258 - 1266
  • [2] Hyperspectral reconstruction from a single textile RGB image based on the generative adversarial network
    Liu, Yue
    Zhang, Jianxin
    Zhang, Yupeng
    [J]. TEXTILE RESEARCH JOURNAL, 2023, 93 (1-2) : 307 - 316
  • [3] Monocular Image Depth Estimation Using a Conditional Generative Adversarial Net
    Zhang, Xiaofeng
    Chen, Shuo
    Xu, Qingyang
    Zhang, Xiaoxue
    [J]. 2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 9176 - 9180
  • [4] Depth Estimation and Semantic Segmentation from a Single RGB Image Using a Hybrid Convolutional Neural Network
    Lin, Xiao
    Sanchez-Escobedo, Dalila
    Casas, Josep R.
    Pardas, Montse
    [J]. SENSORS, 2019, 19 (08)
  • [5] Single-Image Depth Inference Using Generative Adversarial Networks
    Tan, Daniel Stanley
    Yao, Chih-Yuan
    Ruiz, Conrado, Jr.
    Hua, Kai-Lung
    [J]. SENSORS, 2019, 19 (07)
  • [6] Extreme Image Compression Using Fine-tuned VQGANs
    Mao, Qi
    Yang, Tinghan
    Zhang, Yinuo
    Wang, Zijian
    Wang, Meng
    Wang, Shiqi
    Jin, Libiao
    Ma, Siwei
    [J]. 2024 DATA COMPRESSION CONFERENCE, DCC, 2024, : 203 - 212
  • [7] Single Image Haze Removal using a Generative Adversarial Network
    Raj, Bharath N.
    Venketeswaran, N.
    [J]. 2020 INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS SIGNAL PROCESSING AND NETWORKING (WISPNET), 2020, : 37 - 42
  • [8] Depth map prediction from a single image with generative adversarial nets
    Shaoyong Zhang
    Na Li
    Chenchen Qiu
    Zhibin Yu
    Haiyong Zheng
    Bing Zheng
    [J]. Multimedia Tools and Applications, 2020, 79 : 14357 - 14374
  • [9] Depth map prediction from a single image with generative adversarial nets
    Zhang, Shaoyong
    Li, Na
    Qiu, Chenchen
    Yu, Zhibin
    Zheng, Haiyong
    Zheng, Bing
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (21-22) : 14357 - 14374
  • [10] Synthesis of realistic food dataset using generative adversarial network based on RGB and depth images
    Al Aama, Obada
    Tamukoh, Hakaru
    [J]. PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON ARTIFICIAL LIFE AND ROBOTICS (ICAROB 2021), 2021, : 16 - 19