Geometry-Aware Symmetric Domain Adaptation for Monocular Depth Estimation

被引:120
|
作者
Zhao, Shanshan [1 ]
Fu, Huan [1 ]
Gong, Mingming [2 ,3 ]
Tao, Dacheng [1 ]
机构
[1] Univ Sydney, UBTECH Sydney AI Ctr, Sch Comp Sci, FEIT, Darlington, NSW 2008, Australia
[2] Univ Pittsburgh, Dept Biomed Informat, Pittsburgh, PA 15260 USA
[3] Carnegie Mellon Univ, Dept Philosophy, Pittsburgh, PA 15213 USA
基金
澳大利亚研究理事会;
关键词
KERNEL;
D O I
10.1109/CVPR.2019.01002
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Supervised depth estimation has achieved high accuracy due to the advanced deep network architectures. Since the groundtruth depth labels are hard to obtain, recent methods try to learn depth estimation networks in an unsupervised way by exploring unsupervised cues, which are effective but less reliable than true labels. An emerging way to resolve this dilemma is to transfer knowledge from synthetic images with ground truth depth via domain adaptation techniques. However, these approaches overlook specific geometric structure of the natural images in the target domain (i.e., real data), which is important for high performing depth prediction. Motivated by the observation, we propose a geometry-aware symmetric domain adaptation framework (GASDA) to explore the labels in the synthetic data and epipolar geometry in the real data jointly. Moreover, by training two image style translators and depth estimators symmetrically in an end-to-end network, our model achieves better image style transfer and generates high-quality depth maps. The experimental results demonstrate the effectiveness of our proposed method and comparable performance against the state-of-the-art.
引用
收藏
页码:9780 / 9790
页数:11
相关论文
共 50 条
  • [1] A geometry-aware deep network for depth estimation in monocular endoscopy
    Yang, Yongming
    Shao, Shuwei
    Yang, Tao
    Wang, Peng
    Yang, Zhuo
    Wu, Chengdong
    Liu, Hao
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 122
  • [2] OmniFusion: 360 Monocular Depth Estimation via Geometry-Aware Fusion
    Li, Yuyan
    Guo, Yuliang
    Yan, Zhixin
    Huang, Xinyu
    Duan, Ye
    Ren, Liu
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 2791 - 2800
  • [3] Discriminative and Geometry-Aware Unsupervised Domain Adaptation
    Luo, Lingkun
    Chen, Liming
    Hu, Shiqiang
    Lu, Ying
    Wang, Xiaofang
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (09) : 3914 - 3927
  • [4] Geometry-Aware Unsupervised Domain Adaptation for Stereo Matching
    Sakuma, Hiroki
    Konishi, Yoshinori
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 6116 - 6123
  • [5] Geometry-aware Domain Adaptation for Unsupervised Alignment of Word Embeddings
    Jawanpuria, Pratik
    Meghwanshi, Mayank
    Mishra, Bamdev
    [J]. 58TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2020), 2020, : 3052 - 3058
  • [6] Domain Adaptation on Point Clouds via Geometry-Aware Implicits
    Shen, Yuefan
    Yang, Yanchao
    Yan, Mi
    Wang, He
    Zheng, Youyi
    Guibas, Leonidas
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 7213 - 7222
  • [7] GOPE: Geometry-Aware Optimal Viewpoint Path Estimation Using a Monocular Camera
    Kim, Nuri
    Choi, Yunho
    Kang, Minjae
    Oh, Songhwai
    [J]. 2020 20TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS), 2020, : 1062 - 1067
  • [8] Geometry-Aware Adaptation for Pretrained Models
    Roberts, Nicholas
    Li, Xintong
    Adila, Dyah
    Cromp, Sonia
    Huang, Tzu-Heng
    Zhao, Jitian
    Sala, Frederic
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [9] Depth Completion using Geometry-Aware Embedding
    Du, Wenchao
    Chen, Hu
    Yang, Hongyu
    Zhang, Yi
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2022, 2022, : 8680 - 8686
  • [10] Test-time Domain Adaptation for Monocular Depth Estimation
    Li, Zhi
    Sh, Shaoshuai
    Schiele, Bernt
    Dai, Dengxin
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 4873 - 4879