Self-supervised coarse-to-fine monocular depth estimation using a lightweight attention module

被引:0
|
作者
Yuanzhen Li
Fei Luo
Chunxia Xiao
机构
[1] Wuhan University,School of Computer Science
来源
关键词
monocular depth estimation; texture copy; depth drift; attention module;
D O I
暂无
中图分类号
学科分类号
摘要
Self-supervised monocular depth estimation has been widely investigated and applied in previous works. However, existing methods suffer from texture-copy, depth drift, and incomplete structure. It is difficult for normal CNN networks to completely understand the relationship between the object and its surrounding environment. Moreover, it is hard to design the depth smoothness loss to balance depth smoothness and sharpness. To address these issues, we propose a coarse-to-fine method with a normalized convolutional block attention module (NCBAM). In the coarse estimation stage, we incorporate the NCBAM into depth and pose networks to overcome the texture-copy and depth drift problems. Then, we use a new network to refine the coarse depth guided by the color image and produce a structure-preserving depth result in the refinement stage. Our method can produce results competitive with state-of-the-art methods. Comprehensive experiments prove the effectiveness of our two-stage method using the NCBAM.
引用
下载
收藏
页码:631 / 647
页数:16
相关论文
共 50 条
  • [41] Self-Supervised Monocular Depth Estimation Using Hybrid Transformer Encoder
    Hwang, Seung-Jun
    Park, Sung-Jun
    Baek, Joong-Hwan
    Kim, Byungkyu
    IEEE SENSORS JOURNAL, 2022, 22 (19) : 18762 - 18770
  • [42] MDSNet: self-supervised monocular depth estimation for video sequences using self-attention and threshold mask
    Zhao, Jiaqi
    Zhao, Chaoyue
    Liu, Chunling
    Zhang, Chaojian
    Zhang, Wang
    JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (05)
  • [43] Self-supervised monocular depth estimation via joint attention and intelligent mask loss
    Peng Guo
    Shuguo Pan
    Wang Gao
    Kourosh Khoshelham
    Pan, Shuguo (1293266098@qq.com), 2025, 36 (01)
  • [44] ATTENTION-BASED SELF-SUPERVISED LEARNING MONOCULAR DEPTH ESTIMATION WITH EDGE REFINEMENT
    Jiang, Chenweinan
    Liu, Haichun
    Li, Lanzhen
    Pan, Changchun
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3218 - 3222
  • [45] Lite-Mono: A Lightweight CNN and Transformer Architecture for Self-Supervised Monocular Depth Estimation
    Zhang, Ning
    Nex, Francesco
    Vosselman, George
    Kerle, Norman
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 18537 - 18546
  • [46] Repmono: a lightweight self-supervised monocular depth estimation architecture for high-speed inference
    Zhang, Guowei
    Tang, Xincheng
    Wang, Li
    Cui, Huankang
    Fei, Teng
    Tang, Hulin
    Jiang, Shangfeng
    COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (06) : 7927 - 7941
  • [47] Self-Supervised Monocular Depth Estimation With 3-D Displacement Module for Laparoscopic Images
    Xu, Chi
    Huang, Baoru
    Elson, Daniel S.
    IEEE TRANSACTIONS ON MEDICAL ROBOTICS AND BIONICS, 2022, 4 (02): : 331 - 334
  • [48] Monocular Depth Estimation via Self-Supervised Self-Distillation
    Hu, Haifeng
    Feng, Yuyang
    Li, Dapeng
    Zhang, Suofei
    Zhao, Haitao
    SENSORS, 2024, 24 (13)
  • [49] Frequency-Aware Self-Supervised Monocular Depth Estimation
    Chen, Xingyu
    Li, Thomas H.
    Zhang, Ruonan
    Li, Ge
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 5797 - 5806
  • [50] Self-Supervised Monocular Depth Estimation by Digging into Uncertainty Quantification
    Li, Yuan-Zhen
    Zheng, Sheng-Jie
    Tan, Zi-Xin
    Cao, Tuo
    Luo, Fei
    Xiao, Chun-Xia
    JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2023, 38 (03) : 510 - 525