Unsupervised High-Resolution Depth Learning From Videos With Dual Networks

被引:44
|
作者
Zhou, Junsheng [1 ]
Wang, Yuwang [2 ]
Qin, Kaihuai [1 ]
Zeng, Wenjun [2 ]
机构
[1] Tsinghua Univ, Beijing, Peoples R China
[2] Microsoft Res, Beijing, Peoples R China
关键词
D O I
10.1109/ICCV.2019.00697
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised depth learning takes the appearance difference between a target view and a view synthesized from its adjacent frame as supervisory signal. Since the supervisory signal only comes from images themselves, the resolution of training data significantly impacts the performance. High-resolution images contain more fine-grained details and provide more accurate supervisory signal. However, due to the limitation of memory and computation power, the original images are typically down-sampled during training, which suffers heavy loss of details and disparity accuracy. In order to fully explore the information contained in high-resolution data, we propose a simple yet effective dual networks architecture, which can directly take high-resolution images as input and generate high-resolution and high-accuracy depth map efficiently. We also propose a Self-assembled Attention (SA-Attention) module to handle low-texture region. The evaluation on the benchmark KITTI and Make3D datasets demonstrates that our method achieves state-of-the-art results in the monocular depth estimation task.
引用
收藏
页码:6871 / 6880
页数:10
相关论文
共 50 条
  • [41] Unsupervised Super-Resolution: Creating High-Resolution Medical Images from Low-Resolution Anisotropic Examples
    Sander, Joerg
    de Vos, Bob D.
    Isgum, Ivana
    MEDICAL IMAGING 2021: IMAGE PROCESSING, 2021, 11596
  • [42] Synthesis of a high-resolution 3D-stereoscopic image pair from a high-resolution monoscopic image and a low-resolution depth map
    Kim, KT
    Siegel, M
    Son, JY
    STEREOSCOPIC DISPLAYS AND VIRTUAL REALITY SYSTEMS V, 1998, 3295 : 76 - 86
  • [43] High-Resolution Polar Low Winds Obtained from Unsupervised SAR Wind Retrieval
    Tollinger, Mathias
    Graversen, Rune
    Johnsen, Harald
    REMOTE SENSING, 2021, 13 (22)
  • [44] Unsupervised Deep Joint Segmentation of Multitemporal High-Resolution Images
    Saha, Sudipan
    Mou, Lichao
    Qiu, Chunping
    Zhu, Xiao Xiang
    Bovolo, Francesca
    Bruzzone, Lorenzo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (12): : 8780 - 8792
  • [45] Unsupervised Learning of Depth and Depth-of-Field Effect from Natural Images with Aperture Rendering Generative Adversarial Networks
    Kaneko, Takuhiro
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 15674 - 15683
  • [46] Reconstructing sparsely represented high-resolution depth map from corrupted samples
    Fan, Hanqi
    Kong, Dexing
    Li, Jinhong
    Peng, Qunsheng
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2016, 28 (02): : 260 - 270
  • [47] HIGH-RESOLUTION DEPTH PROFILING OF LIGHT-ELEMENTS
    DOLLINGER, G
    FAESTERMANN, T
    MAIERKOMOR, P
    NUCLEAR INSTRUMENTS & METHODS IN PHYSICS RESEARCH SECTION B-BEAM INTERACTIONS WITH MATERIALS AND ATOMS, 1992, 64 (1-4): : 422 - 427
  • [48] High-resolution depth measurements in digital microscopic surgery
    Babilon, Sebastian
    Myland, Paul
    Schlestein, Lucas
    Klabes, Julian
    Khanh, Tran Quoc
    ENGINEERING REPORTS, 2021, 3 (04)
  • [49] HOLOGRAPHIC AXILENS - HIGH-RESOLUTION AND LONG FOCAL DEPTH
    DAVIDSON, N
    FRIESEM, AA
    HASMAN, E
    OPTICS LETTERS, 1991, 16 (07) : 523 - 525
  • [50] Flooding Water Depth Estimation With High-Resolution SAR
    Iervolino, Pasquale
    Guida, Raffaella
    Iodice, Antonio
    Riccio, Daniele
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (05): : 2295 - 2307