LAM-Depth: Laplace-Attention Module-Based Self-Supervised Monocular Depth Estimation

被引:0
|
作者
Wei, Jiansheng [1 ]
Pan, Shuguo [1 ]
Gao, Wang [1 ]
Guo, Peng [1 ]
机构
[1] Southeast Univ, Sch Instrument Sci & Engn, Key Lab Microinertial Instrument & Adv Nav Technol, Minist Educ, Nanjing 210096, Peoples R China
关键词
Estimation; Laplace equations; Training; Laser radar; Decoding; Data models; Three-dimensional displays; Scene perception; monocular depth estimation; self-supervised; attention unit; NETWORK; FUSION;
D O I
10.1109/TITS.2024.3402655
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Depth estimation is extremely important in the world of driverless vehicles, which can provide key distance information for 3D scene perception and local path planning. Using convolutional neural network (CNN) to completely recover depth information from monocular images becomes a hot research trend. Supervised monocular depth estimation needs large numbers of per-pixel ground-truth depth data collected from LiDAR to train the model. This leads to high resource consumption and poor generalization ability. For the above reasons, the self-supervised learning method seems to be a promising alternative to monocular depth estimation. However, the up-sampling operations in existing encoder-decoder based architecture may lose some critical image information, which leads to boundary blurring and depth artifact in depth maps. In this paper, the Laplace-Attention module based self-supervised monocular depth estimation network (LAM-Depth) is designed to resolve this problem. Specifically, multi-scale Laplacian features are introduced into the corresponding streams in the decoder to fuse the low-level and skip-connection features. The concatenated features are then re-calibrated with a channel-wise attention unit for emphasizing the Laplacian features. Based on the above operations, the image information is preserved to the greatest extent in feature processing. The experiment results show that the proposed model LAM-Depth achieves a high ranking among the existing unsupervised methods and outperforms several supervised models trained with LiDAR data. Furthermore, we conduct experiments in real scenes to evaluate the generalization ability of LAM-Depth and obtain high-quality depth maps.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Self-Supervised Monocular Depth Estimation Based on Channel Attention
    Tao, Bo
    Chen, Xinbo
    Tong, Xiliang
    Jiang, Du
    Chen, Baojia
    [J]. PHOTONICS, 2022, 9 (06)
  • [2] MonoVAN: Visual Attention for Self-Supervised Monocular Depth Estimation
    Indyk, Ilia
    Makarov, Ilya
    [J]. 2023 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY, ISMAR, 2023, : 1211 - 1220
  • [3] Self-supervised coarse-to-fine monocular depth estimation using a lightweight attention module
    Yuanzhen Li
    Fei Luo
    Chunxia Xiao
    [J]. Computational Visual Media, 2022, 8 : 631 - 647
  • [4] Self-supervised coarse-to-fine monocular depth estimation using a lightweight attention module
    Li, Yuanzhen
    Luo, Fei
    Xiao, Chunxia
    [J]. COMPUTATIONAL VISUAL MEDIA, 2022, 8 (04) : 631 - 647
  • [5] Digging Into Self-Supervised Monocular Depth Estimation
    Godard, Clement
    Mac Aodha, Oisin
    Firman, Michael
    Brostow, Gabriel
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 3827 - 3837
  • [6] Self-supervised monocular depth estimation in fog
    Tao, Bo
    Hu, Jiaxin
    Jiang, Du
    Li, Gongfa
    Chen, Baojia
    Qian, Xinbo
    [J]. OPTICAL ENGINEERING, 2023, 62 (03)
  • [7] On the uncertainty of self-supervised monocular depth estimation
    Poggi, Matteo
    Aleotti, Filippo
    Tosi, Fabio
    Mattoccia, Stefano
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 3224 - 3234
  • [8] Revisiting Self-supervised Monocular Depth Estimation
    Kim, Ue-Hwan
    Lee, Gyeong-Min
    Kim, Jong-Hwan
    [J]. ROBOT INTELLIGENCE TECHNOLOGY AND APPLICATIONS 6, 2022, 429 : 336 - 350
  • [9] ATTENTION-BASED SELF-SUPERVISED LEARNING MONOCULAR DEPTH ESTIMATION WITH EDGE REFINEMENT
    Jiang, Chenweinan
    Liu, Haichun
    Li, Lanzhen
    Pan, Changchun
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3218 - 3222
  • [10] ADAADepth: Adapting Data Augmentation and Attention for Self-Supervised Monocular Depth Estimation
    Kaushik, Vinay
    Jindgar, Kartik
    Lall, Brejesh
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) : 7791 - 7798