Unsupervised Adversarial Depth Estimation using Cycled Generative Networks

被引:116
|
作者
Pilzer, Andrea [1 ]
Xu, Dan [2 ]
Puscas, Mihai Marian [1 ]
Ricci, Elisa [1 ,3 ]
Sebe, Nicu [1 ]
机构
[1] Univ Trento, DISI, Via Sommarive 14, Povo, TN, Italy
[2] Univ Oxford, Dept Engn Sci, 17 Parks Rd, Oxford, England
[3] Fdn Bruno Kessler, Technol Vis, Via Sommarive 18, Povo, TN, Italy
关键词
D O I
10.1109/3DV.2018.00073
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
While recent deep monocular depth estimation approaches based on supervised regression have achieved remarkable performance, costly ground truth annotations are required during training. lb cope with this issue, in this paper we present a novel unsupervised deep learning approach for predicting depth maps and show that the depth estimation task can be effectively tackled within an adversarial learning framework Specifically, we propose a deep generative network that learns to predict the correspondence field (i.e. the disparity map) between two image views in a calibrated stereo camera setting. The proposed architecture consists of two generative sub-networks jointly trained with adversarial learning for reconstructing the disparity map and organized in a cycle such as to provide mutual constraints and supervision to each other. Extensive experiments on the publicly available datasets Kr/TI and Cityscapes demonstrate the effectiveness of the proposed model and competitive results with state of the art methods. The code is available at https://github.com/andrea-pilzer/unsup-stereo-depthGAN
引用
收藏
页码:587 / 595
页数:9
相关论文
共 50 条
  • [21] Unsupervised Image Generation with Infinite Generative Adversarial Networks
    Ying, Hui
    Wang, He
    Shao, Tianjia
    Yang, Yin
    Zhou, Kun
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14264 - 14273
  • [22] Unsupervised Semantic Generative Adversarial Networks for Expert Retrieval
    Liang, Shangsong
    WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019), 2019, : 1039 - 1050
  • [23] Unsupervised Diverse Colorization via Generative Adversarial Networks
    Cao, Yun
    Zhou, Zhiming
    Zhang, Weinan
    Yu, Yong
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2017, PT I, 2017, 10534 : 151 - 166
  • [24] Single-Image Depth Inference Using Generative Adversarial Networks
    Tan, Daniel Stanley
    Yao, Chih-Yuan
    Ruiz, Conrado, Jr.
    Hua, Kai-Lung
    SENSORS, 2019, 19 (07)
  • [25] Unsupervised Detection of Lung Nodules in Chest Radiography Using Generative Adversarial Networks
    Bhatt, Nitish
    Prados, David Ramon
    Hodzic, Nedim
    Karanassios, Christos
    Tizhoosh, H.R.
    Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, 2021, : 3842 - 3845
  • [26] Unsupervised Learning Using Generative Adversarial Networks on micro-Doppler spectrograms
    Donerty, H. Garcia
    Cifola, L.
    Harmanny, R. I. A.
    Fioranelli, F.
    2019 16TH EUROPEAN RADAR CONFERENCE (EURAD), 2019, : 197 - 200
  • [27] Unsupervised Detection of Lung Nodules in Chest Radiography Using Generative Adversarial Networks
    Bhatt, Nitish
    Prados, David Ramon
    Hodzic, Nedim
    Karanassios, Christos
    Tizhoosh, H. R.
    2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, : 3842 - 3845
  • [28] Unsupervised Domain Adaptation for Facial Expression Recognition Using Generative Adversarial Networks
    Wang, Xiaoqing
    Wang, Xiangjun
    Ni, Yubo
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2018, 2018
  • [29] Unsupervised Learning of Depth and Depth-of-Field Effect from Natural Images with Aperture Rendering Generative Adversarial Networks
    Kaneko, Takuhiro
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 15674 - 15683
  • [30] Structured Adversarial Training for Unsupervised Monocular Depth Estimation
    Mehta, Ishit
    Sakurikar, Parikshit
    Narayanan, P. J.
    2018 INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2018, : 314 - 323