Unsupervised High-Resolution Depth Learning From Videos With Dual Networks

被引:44
|
作者
Zhou, Junsheng [1 ]
Wang, Yuwang [2 ]
Qin, Kaihuai [1 ]
Zeng, Wenjun [2 ]
机构
[1] Tsinghua Univ, Beijing, Peoples R China
[2] Microsoft Res, Beijing, Peoples R China
关键词
D O I
10.1109/ICCV.2019.00697
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised depth learning takes the appearance difference between a target view and a view synthesized from its adjacent frame as supervisory signal. Since the supervisory signal only comes from images themselves, the resolution of training data significantly impacts the performance. High-resolution images contain more fine-grained details and provide more accurate supervisory signal. However, due to the limitation of memory and computation power, the original images are typically down-sampled during training, which suffers heavy loss of details and disparity accuracy. In order to fully explore the information contained in high-resolution data, we propose a simple yet effective dual networks architecture, which can directly take high-resolution images as input and generate high-resolution and high-accuracy depth map efficiently. We also propose a Self-assembled Attention (SA-Attention) module to handle low-texture region. The evaluation on the benchmark KITTI and Make3D datasets demonstrates that our method achieves state-of-the-art results in the monocular depth estimation task.
引用
收藏
页码:6871 / 6880
页数:10
相关论文
共 50 条
  • [1] Unsupervised Learning of Monocular Depth from Videos
    Gao Haosheng
    Teng Wang
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 3945 - 3950
  • [2] Depth from Videos in the Wild: Unsupervised Monocular Depth Learning from Unknown Cameras
    Gordon, Ariel
    Li, Hanhan
    Jonschkowski, Rico
    Angelova, Anelia
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 8976 - 8985
  • [3] Region Deformer Networks for Unsupervised Depth Estimation from Unconstrained Monocular Videos
    Xu, Haofei
    Zheng, Jianmin
    Cai, Jianfei
    Zhang, Juyong
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 5685 - 5691
  • [4] Unsupervised learning from videos using temporal coherency deep networks
    Redondo-Cabrera, Carolina
    Lopez-Sastre, Roberto
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 179 : 79 - 89
  • [5] Depth Prediction without the Sensors: Leveraging Structure for Unsupervised Learning from Monocular Videos
    Casser, Vincent
    Pirk, Soeren
    Mahjourian, Reza
    Angelova, Anelia
    THIRTY-THIRD AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FIRST INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / NINTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2019, : 8001 - 8008
  • [6] Unsupervised Learning of Geometry from Videos with Edge-Aware Depth-Normal Consistency
    Yang, Zhenheng
    Wang, Peng
    Xu, Wei
    Zhao, Liang
    Nevatia, Ramakant
    THIRTY-SECOND AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTIETH INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE CONFERENCE / EIGHTH AAAI SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2018, : 7493 - 7500
  • [7] Unsupervised Learning from Narrated Instruction Videos
    Alayrac, Jean-Baptiste
    Bojanowski, Piotr
    Agrawal, Nishant
    Sivic, Josef
    Laptev, Ivan
    Lacoste-Julien, Simon
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 4575 - 4583
  • [8] Fast Object Detection in High-Resolution Videos
    Tran, Ryan
    Kanaujia, Atul
    Parameswaran, Vasu
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 1461 - 1470
  • [9] Structurally-Constrained Unsupervised Deep Learning for Seismic High-Resolution Reconstruction
    Wang, Yongxiao
    Xu, Jingyi
    Zhao, Zhencong
    Gao, Yang
    Zhang, Hao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 15
  • [10] High-Resolution Vehicle Trajectory Extraction and Denoising From Aerial Videos
    Chen, Xinqiang
    Li, Zhibin
    Yang, Yongsheng
    Qi, Lei
    Ke, Ruimin
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (05) : 3190 - 3202