Unsupervised Adversarial Depth Estimation using Cycled Generative Networks

被引:116
|
作者
Pilzer, Andrea [1 ]
Xu, Dan [2 ]
Puscas, Mihai Marian [1 ]
Ricci, Elisa [1 ,3 ]
Sebe, Nicu [1 ]
机构
[1] Univ Trento, DISI, Via Sommarive 14, Povo, TN, Italy
[2] Univ Oxford, Dept Engn Sci, 17 Parks Rd, Oxford, England
[3] Fdn Bruno Kessler, Technol Vis, Via Sommarive 18, Povo, TN, Italy
关键词
D O I
10.1109/3DV.2018.00073
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
While recent deep monocular depth estimation approaches based on supervised regression have achieved remarkable performance, costly ground truth annotations are required during training. lb cope with this issue, in this paper we present a novel unsupervised deep learning approach for predicting depth maps and show that the depth estimation task can be effectively tackled within an adversarial learning framework Specifically, we propose a deep generative network that learns to predict the correspondence field (i.e. the disparity map) between two image views in a calibrated stereo camera setting. The proposed architecture consists of two generative sub-networks jointly trained with adversarial learning for reconstructing the disparity map and organized in a cycle such as to provide mutual constraints and supervision to each other. Extensive experiments on the publicly available datasets Kr/TI and Cityscapes demonstrate the effectiveness of the proposed model and competitive results with state of the art methods. The code is available at https://github.com/andrea-pilzer/unsup-stereo-depthGAN
引用
收藏
页码:587 / 595
页数:9
相关论文
共 50 条
  • [41] Estimation of Electrical Characteristics of Inhomogeneous Walls Using Generative Adversarial Networks
    Yasmeen, Kainat
    Ram, Shobha Sundar
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 7009 - 7023
  • [42] Improved QT ınterval estimation using conditional generative adversarial networks
    Al−Zaben A.
    Al−Abed M.
    Neural Computing and Applications, 2024, 36 (18) : 10777 - 10789
  • [43] Data driven background estimation in HEP using generative adversarial networks
    Victor Lohezic
    Mehmet Ozgur Sahin
    Fabrice Couderc
    Julie Malcles
    The European Physical Journal C, 83
  • [44] Data driven background estimation in HEP using generative adversarial networks
    Lohezic, Victor
    Sahin, Mehmet Ozgur
    Couderc, Fabrice
    Malcles, Julie
    EUROPEAN PHYSICAL JOURNAL C, 2023, 83 (03):
  • [45] Quantifying Uncertainty In Traffic State Estimation Using Generative Adversarial Networks
    Mo, Zhaobin
    Fu, Yongjie
    Di, Xuan
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 2769 - 2774
  • [46] Unsupervised Monocular Depth Estimation and Visual Odometry Based on Generative Adversarial Network and Self-attention Mechanism
    Ye X.
    He Y.
    Ru S.
    Jiqiren/Robot, 2021, 43 (02): : 203 - 213
  • [47] EAGAN: Event-based attention generative adversarial networks for optical flow and depth estimation
    Lin, Xiuhong
    Yang, Chenhui
    Bian, Xuesheng
    Liu, Weiquan
    Wang, Cheng
    IET COMPUTER VISION, 2022, 16 (07) : 581 - 595
  • [48] Publisher Correction: Unsupervised anomaly detection with generative adversarial networks in mammography
    Seungju Park
    Kyung Hwa Lee
    Beomseok Ko
    Namkug Kim
    Scientific Reports, 13
  • [49] An unsupervised font style transfer model based on generative adversarial networks
    Zeng, Sihan
    Pan, Zhongliang
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (04) : 5305 - 5324
  • [50] Pansharpening Using Unsupervised Generative Adversarial Networks With Recursive Mixed-Scale Feature Fusion
    Wu, Yuanyuan
    Li, Yuchun
    Feng, Siling
    Huang, Mengxing
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 3742 - 3759