Towards Better Data Exploitation in Self-Supervised Monocular Depth Estimation

被引:1
|
作者
Liu, Jinfeng [1 ]
Kong, Lingtong [1 ]
Yang, Jie [1 ]
Liu, Wei [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning for visual perception; deep learning methods; visual Learning;
D O I
10.1109/LRA.2023.3337594
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Depth estimation plays an important role in robotic perception systems. The self-supervised monocular paradigm has gained significant attention since it can free training from the reliance on depth annotations. Despite recent advancements, existing self-supervised methods still underutilize the available training data, limiting their generalization ability. In this letter, we take two data augmentation techniques, namely Resizing-Cropping and Splitting-Permuting, to fully exploit the potential of training datasets. Specifically, the original image and the generated two augmented images are fed into the training pipeline simultaneously and we leverage them to conduct self-distillation. Additionally, we introduce the detail-enhanced DepthNet with an extra full-scale branch in the encoder and a grid decoder to enhance the restoration of fine details in depth maps. Experimental results demonstrate our method can achieve state-of-the-art performance on the KITTI and Cityscapes datasets. Moreover, our KITTI models also show superior generalization performance when transferring to Make3D, NYUv2 and Cityscapes datasets.
引用
收藏
页码:763 / 770
页数:8
相关论文
共 50 条
  • [11] Self-supervised monocular depth estimation with direct methods
    Wang H.
    Sun Y.
    Wu Q.M.J.
    Lu X.
    Wang X.
    Zhang Z.
    [J]. Neurocomputing, 2021, 421 : 340 - 348
  • [12] Self-supervised monocular depth estimation with direct methods
    Wang, Haixia
    Sun, Yehao
    Wu, Q. M. Jonathan
    Lu, Xiao
    Wang, Xiuling
    Zhang, Zhiguo
    [J]. NEUROCOMPUTING, 2021, 421 : 340 - 348
  • [13] Adaptive Self-supervised Depth Estimation in Monocular Videos
    Mendoza, Julio
    Pedrini, Helio
    [J]. IMAGE AND GRAPHICS (ICIG 2021), PT III, 2021, 12890 : 687 - 699
  • [14] Self-Supervised Monocular Depth Estimation With Multiscale Perception
    Zhang, Yourun
    Gong, Maoguo
    Li, Jianzhao
    Zhang, Mingyang
    Jiang, Fenlong
    Zhao, Hongyu
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 3251 - 3266
  • [15] Learn to Adapt for Self-Supervised Monocular Depth Estimation
    Sun, Qiyu
    Yen, Gary G. G.
    Tang, Yang
    Zhao, Chaoqiang
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 35 (11) : 1 - 13
  • [16] Self-Supervised Monocular Depth Estimation With Multiscale Perception
    Zhang, Yourun
    Gong, Maoguo
    Li, Jianzhao
    Zhang, Mingyang
    Jiang, Fenlong
    Zhao, Hongyu
    [J]. IEEE Transactions on Image Processing, 2022, 31 : 3251 - 3266
  • [17] Self-Supervised Monocular Depth Estimation With Extensive Pretraining
    Choi, Hyukdoo
    [J]. IEEE ACCESS, 2021, 9 : 157236 - 157246
  • [18] Self-Supervised Monocular Depth Estimation with Extensive Pretraining
    Choi, Hyukdoo
    [J]. IEEE Access, 2021, 9 : 157236 - 157246
  • [19] ADAADepth: Adapting Data Augmentation and Attention for Self-Supervised Monocular Depth Estimation
    Kaushik, Vinay
    Jindgar, Kartik
    Lall, Brejesh
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) : 7791 - 7798
  • [20] MonoIndoor: Towards Good Practice of Self-Supervised Monocular Depth Estimation for Indoor Environments
    Ji, Pan
    Li, Runze
    Bhanu, Bir
    Xu, Yi
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 12767 - 12776