Unsupervised Adversarial Depth Estimation using Cycled Generative Networks

被引:116
|
作者
Pilzer, Andrea [1 ]
Xu, Dan [2 ]
Puscas, Mihai Marian [1 ]
Ricci, Elisa [1 ,3 ]
Sebe, Nicu [1 ]
机构
[1] Univ Trento, DISI, Via Sommarive 14, Povo, TN, Italy
[2] Univ Oxford, Dept Engn Sci, 17 Parks Rd, Oxford, England
[3] Fdn Bruno Kessler, Technol Vis, Via Sommarive 18, Povo, TN, Italy
关键词
D O I
10.1109/3DV.2018.00073
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
While recent deep monocular depth estimation approaches based on supervised regression have achieved remarkable performance, costly ground truth annotations are required during training. lb cope with this issue, in this paper we present a novel unsupervised deep learning approach for predicting depth maps and show that the depth estimation task can be effectively tackled within an adversarial learning framework Specifically, we propose a deep generative network that learns to predict the correspondence field (i.e. the disparity map) between two image views in a calibrated stereo camera setting. The proposed architecture consists of two generative sub-networks jointly trained with adversarial learning for reconstructing the disparity map and organized in a cycle such as to provide mutual constraints and supervision to each other. Extensive experiments on the publicly available datasets Kr/TI and Cityscapes demonstrate the effectiveness of the proposed model and competitive results with state of the art methods. The code is available at https://github.com/andrea-pilzer/unsup-stereo-depthGAN
引用
收藏
页码:587 / 595
页数:9
相关论文
共 50 条
  • [31] Recurrent generative adversarial networks for unsupervised WCE video summarization
    Lan, Libin
    Ye, Chunxiao
    KNOWLEDGE-BASED SYSTEMS, 2021, 222
  • [32] Unsupervised Tumor Characterization via Conditional Generative Adversarial Networks
    Quoc Dang Vu
    Kim, Kyungeun
    Kwak, Jin Tae
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2021, 25 (02) : 348 - 357
  • [33] Unsupervised Video Summarization with Attentive Conditional Generative Adversarial Networks
    He, Xufeng
    Hua, Yang
    Song, Tao
    Zhang, Zongpu
    Xue, Zhengui
    Ma, Ruhui
    Robertson, Neil
    Guan, Haibing
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 2296 - 2304
  • [34] Realistic image generation using adversarial generative networks combined with depth information
    Yu, Qi
    Yu, Lan
    Li, Guangju
    Jin, Dehu
    Qi, Meng
    DIGITAL SIGNAL PROCESSING, 2023, 143
  • [35] Channel Estimation Enhancement With Generative Adversarial Networks
    Hu, Tianyu
    Huang, Yang
    Zhu, Qiuming
    Wu, Qihui
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2021, 7 (01) : 145 - 156
  • [36] Unsupervised Feature Propagation for Fast Video Object Detection Using Generative Adversarial Networks
    Zhang, Xuan
    Han, Guangxing
    He, Wenduo
    MULTIMEDIA MODELING (MMM 2020), PT I, 2020, 11961 : 617 - 627
  • [37] Unsupervised Domain Adaptation Using Generative Adversarial Networks for Semantic Segmentation of Aerial Images
    Benjdira, Bilel
    Bazi, Yakoub
    Koubaa, Anis
    Ouni, Kais
    REMOTE SENSING, 2019, 11 (11)
  • [38] Evaluation Study of Unsupervised Face-to-Face Translation using Generative Adversarial Networks
    Iqbal, Muhamad
    Adnan, Risman
    Widyanto, M. Rahmat
    Basaruddin, T.
    PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND SOFT COMPUTING (ICMLSC 2019), 2019, : 226 - 231
  • [39] An Unsupervised Approach towards Varying Human Skin Tone Using Generative Adversarial Networks
    Roy, Debapriya
    Mukherjee, Diganta
    Chanda, Bhabatosh
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 10681 - 10688
  • [40] Towards histopathological stain invariance by Unsupervised Domain Augmentation using generative adversarial networks
    Vasiljevic, Jelica
    Feuerhake, Friedrich
    Wemmert, Cedric
    Lampert, Thomas
    NEUROCOMPUTING, 2021, 460 (460) : 277 - 291