Unsupervised Adversarial Depth Estimation using Cycled Generative Networks

被引:116
|
作者
Pilzer, Andrea [1 ]
Xu, Dan [2 ]
Puscas, Mihai Marian [1 ]
Ricci, Elisa [1 ,3 ]
Sebe, Nicu [1 ]
机构
[1] Univ Trento, DISI, Via Sommarive 14, Povo, TN, Italy
[2] Univ Oxford, Dept Engn Sci, 17 Parks Rd, Oxford, England
[3] Fdn Bruno Kessler, Technol Vis, Via Sommarive 18, Povo, TN, Italy
关键词
D O I
10.1109/3DV.2018.00073
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
While recent deep monocular depth estimation approaches based on supervised regression have achieved remarkable performance, costly ground truth annotations are required during training. lb cope with this issue, in this paper we present a novel unsupervised deep learning approach for predicting depth maps and show that the depth estimation task can be effectively tackled within an adversarial learning framework Specifically, we propose a deep generative network that learns to predict the correspondence field (i.e. the disparity map) between two image views in a calibrated stereo camera setting. The proposed architecture consists of two generative sub-networks jointly trained with adversarial learning for reconstructing the disparity map and organized in a cycle such as to provide mutual constraints and supervision to each other. Extensive experiments on the publicly available datasets Kr/TI and Cityscapes demonstrate the effectiveness of the proposed model and competitive results with state of the art methods. The code is available at https://github.com/andrea-pilzer/unsup-stereo-depthGAN
引用
收藏
页码:587 / 595
页数:9
相关论文
共 50 条
  • [1] Structured Coupled Generative Adversarial Networks for Unsupervised Monocular Depth Estimation
    Puscas, Mihai Marian
    Xu, Dan
    Pilzer, Andrea
    Sebe, Niculae
    2019 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2019), 2019, : 18 - 26
  • [2] Progressive Fusion for Unsupervised Binocular Depth Estimation Using Cycled Networks
    Pilzer, Andrea
    Lathuiliere, Stephane
    Xu, Dan
    Puscas, Mihai Marian
    Ricci, Elisa
    Sebe, Nicu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (10) : 2380 - 2395
  • [3] Generative Adversarial Networks for Unsupervised Monocular Depth Prediction
    Aleotti, Filippo
    Tosi, Fabio
    Poggi, Matteo
    Mattoccia, Stefano
    COMPUTER VISION - ECCV 2018 WORKSHOPS, PT I, 2019, 11129 : 337 - 354
  • [4] SGANVO: Unsupervised Deep Visual Odometry and Depth Estimation With Stacked Generative Adversarial Networks
    Feng, Tuo
    Gu, Dongbing
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2019, 4 (04): : 4431 - 4437
  • [5] GANVO: Unsupervised Deep Monocular Visual Odometry and Depth Estimation with Generative Adversarial Networks
    Almalioglu, Yasin
    Saputra, Muhamad Risqi U.
    de Gusmao, Pedro P. B.
    Markham, Andrew
    Trigoni, Niki
    2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 5474 - 5480
  • [6] Efficient unsupervised monocular depth estimation using attention guided generative adversarial network
    Bhattacharyya, Sumanta
    Shen, Ju
    Welch, Stephen
    Chen, Chen
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2021, 18 (04) : 1357 - 1368
  • [7] Efficient unsupervised monocular depth estimation using attention guided generative adversarial network
    Sumanta Bhattacharyya
    Ju Shen
    Stephen Welch
    Chen Chen
    Journal of Real-Time Image Processing, 2021, 18 : 1357 - 1368
  • [8] Face Depth Estimation With Conditional Generative Adversarial Networks
    Arslan, Abdullah Taha
    Seke, Erol
    IEEE ACCESS, 2019, 7 : 23222 - 23231
  • [9] Robust Multimodal Depth Estimation using Transformer based Generative Adversarial Networks
    Khan, Md Fahim Faysal
    Devulapally, Anusha
    Advani, Siddharth
    Narayanan, Vijaykrishnan
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 3559 - 3568
  • [10] Early Experience of Depth Estimation on Intricate Objects Using Generative Adversarial Networks
    San, Wai Y. K.
    Zhang, Teng
    Chen, Shaokang
    Wiliem, Arnold
    Stefanelli, Dario
    Lovell, Brian C.
    2018 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA), 2018, : 163 - 170