Depth Estimation From a Single RGB Image Using Fine-Tuned Generative Adversarial Network

被引:7
|
作者
Ul Islam, Naeem [1 ]
Park, Jaebyung [1 ,2 ]
机构
[1] Jeonbuk Natl Univ, Core Res Inst Intelligent Robots, Jeonju 54896, South Korea
[2] Jeonbuk Natl Univ, Div Elect & Informat Engn, Jeonju 54896, South Korea
来源
IEEE ACCESS | 2021年 / 9卷 / 09期
基金
新加坡国家研究基金会;
关键词
Estimation; Generators; Training; Shape; Robots; Generative adversarial networks; Three-dimensional displays; Generative adversarial network; convolutional neural network; image translation; auto-encoders; TRANSLATION;
D O I
10.1109/ACCESS.2021.3060435
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Estimating the depth map from a single RGB image is important to understand the nature of the terrain in robot navigation and has attracted considerable attention in the past decade. The existing approaches can accurately estimate the depth from a single RGB image, considering a highly structured environment. The problem becomes more challenging when the terrain is highly dynamic. We propose a fine-tuned generative adversarial network to estimate the depth map effectively for a given single RGB image. The proposed network is composed of a fine-tuned generator and a global discriminator. The encoder part of the generator takes input RGB images and depth maps and generates their joint distribution in the latent space. Subsequently, the decoder part of the generator decodes the depth map from the joint distribution. The discriminator takes real and fake pairs in three different configurations and then guides the generator to estimate the depth map from the given RGB image accordingly. Finally, we conducted extensive experiments with a highly dynamic environment dataset for verifying the effectiveness and feasibility of the proposed approach. The proposed approach could decode the depth map from the joint distribution more effectively and accurately than the existing approaches.
引用
收藏
页码:32781 / 32794
页数:14
相关论文
共 50 条
  • [21] RGB-D Image Inpainting Using Generative Adversarial Network with a Late Fusion Approach
    Fujii, Ryo
    Hachiuma, Ryo
    Saito, Hideo
    [J]. AUGMENTED REALITY, VIRTUAL REALITY, AND COMPUTER GRAPHICS, AVR 2020, PT I, 2020, 12242 : 440 - 451
  • [22] Generation of RGB EVG stained image from hyperspectral H and E stained image using generative adversarial network (GAN)
    Biswas, Tanwi
    Suzuki, Hiroyuki
    Ishikawa, Masahiro
    Kobayashi, Naoki
    Obi, Takashi
    [J]. MEDICAL IMAGING 2023, 2023, 12471
  • [23] Synthesis of realistic food dataset using generative adversarial network (GAN) based on RGB and depth images
    Al Aama, Obada
    Tamukoh, Hakaru
    [J]. PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON ARTIFICIAL LIFE AND ROBOTICS (ICAROB 2021), 2021, : P80 - P80
  • [24] Generative adversarial network for image deblurring using generative adversarial constraint loss
    Ji, Y.
    Dai, Y.
    Zhao, K.
    Li, S.
    [J]. DEVELOPMENTS OF ARTIFICIAL INTELLIGENCE TECHNOLOGIES IN COMPUTATION AND ROBOTICS, 2020, 12 : 1180 - 1187
  • [25] Attentive Generative Adversarial Network for Raindrop Removal from A Single Image
    Qian, Rui
    Tan, Robby T.
    Yang, Wenhan
    Su, Jiajun
    Liu, Jiaying
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 2482 - 2491
  • [26] Selective generative adversarial network for raindrop removal from a single image
    Shao, Mingwen
    Li, Le
    Wang, Hong
    Meng, Deyu
    [J]. NEUROCOMPUTING, 2021, 426 : 265 - 273
  • [27] Image Denoising Using A Generative Adversarial Network
    Alsaiari, Abeer
    Rustagi, Ridhi
    Alhakamy, A'eshah
    Thomas, Manu Mathew
    Forbes, Angus G.
    [J]. 2019 IEEE 2ND INTERNATIONAL CONFERENCE ON INFORMATION AND COMPUTER TECHNOLOGIES (ICICT), 2019, : 126 - 132
  • [28] Depth Estimation From a Single Image Using Guided Deep Network
    Song, Minsoo
    Kim, Wonjun
    [J]. IEEE ACCESS, 2019, 7 : 142595 - 142606
  • [29] Infrared and Visible Image Homography Estimation Using Multiscale Generative Adversarial Network
    Luo, Yinhui
    Wang, Xingyi
    Wu, Yuezhou
    Shu, Chang
    [J]. ELECTRONICS, 2023, 12 (04)
  • [30] An unsupervised generative adversarial network for single image deraining
    Song, Zhiying
    Guo, Yuting
    Ma, Zifan
    Tang, Ruocong
    Liu, Linfeng
    [J]. IET IMAGE PROCESSING, 2021, 15 (13) : 3105 - 3117