Self-supervised coarse-to-fine monocular depth estimation using a lightweight attention module

被引:0
|
作者
Yuanzhen Li
Fei Luo
Chunxia Xiao
机构
[1] Wuhan University,School of Computer Science
来源
关键词
monocular depth estimation; texture copy; depth drift; attention module;
D O I
暂无
中图分类号
学科分类号
摘要
Self-supervised monocular depth estimation has been widely investigated and applied in previous works. However, existing methods suffer from texture-copy, depth drift, and incomplete structure. It is difficult for normal CNN networks to completely understand the relationship between the object and its surrounding environment. Moreover, it is hard to design the depth smoothness loss to balance depth smoothness and sharpness. To address these issues, we propose a coarse-to-fine method with a normalized convolutional block attention module (NCBAM). In the coarse estimation stage, we incorporate the NCBAM into depth and pose networks to overcome the texture-copy and depth drift problems. Then, we use a new network to refine the coarse depth guided by the color image and produce a structure-preserving depth result in the refinement stage. Our method can produce results competitive with state-of-the-art methods. Comprehensive experiments prove the effectiveness of our two-stage method using the NCBAM.
引用
收藏
页码:631 / 647
页数:16
相关论文
共 50 条
  • [21] ADAADepth: Adapting Data Augmentation and Attention for Self-Supervised Monocular Depth Estimation
    Kaushik, Vinay
    Jindgar, Kartik
    Lall, Brejesh
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) : 7791 - 7798
  • [22] Joint Soft-Hard Attention for Self-Supervised Monocular Depth Estimation
    Fan, Chao
    Yin, Zhenyu
    Xu, Fulong
    Chai, Anying
    Zhang, Feiqing
    SENSORS, 2021, 21 (21)
  • [23] SQLdepth: Generalizable Self-Supervised Fine-Structured Monocular Depth Estimation
    Wang, Youhong
    Liang, Yunji
    Xu, Hao
    Jiao, Shaohui
    Yu, Hongkai
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 6, 2024, : 5713 - 5721
  • [24] RENA-Depth: toward recursion representation enhancement in neighborhood attention guided lightweight self-supervised monocular depth estimation
    Yang, Chaochao
    Lu, Yuanyao
    Qiu, Yongsheng
    Wang, Yuantao
    OPTICAL ENGINEERING, 2024, 63 (08)
  • [25] Light-Dark: A Novel Lightweight Self-supervised Monocular Depth Estimation in the Dark
    Liang, Qi
    Wang, Lizhe
    Wang, Lanmei
    Liu, Xiang
    Wang, Guibao
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT VII, ICIC 2024, 2024, 14868 : 3 - 14
  • [26] Lightweight Self-supervised Monocular Depth Estimation Method with Enhanced Direction-aware
    Cheng, Deqiang
    Xu, Shuai
    Lü, Chen
    Han, Chenggong
    Jiang, He
    Kou, Qiqi
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2024, 46 (09): : 3683 - 3692
  • [27] Eite-Mono: An Extreme Lightweight Architecture for Self-Supervised Monocular Depth Estimation
    Ren, Chaopeng
    IEEE ACCESS, 2024, 12 : 167010 - 167021
  • [28] Chfnet: a coarse-to-fine hierarchical refinement model for monocular depth estimation
    Chen, Han
    Wang, Yongxiong
    MACHINE VISION AND APPLICATIONS, 2024, 35 (04)
  • [29] ADAPTIVE WEIGHTED NETWORK WITH EDGE ENHANCEMENT MODULE FOR MONOCULAR SELF-SUPERVISED DEPTH ESTIMATION
    Liu, Hong
    Zhu, Ying
    Hua, Guoliang
    Huang, Weibo
    Ding, Runwei
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2340 - 2344
  • [30] Semantically guided self-supervised monocular depth estimation
    Lu, Xiao
    Sun, Haoran
    Wang, Xiuling
    Zhang, Zhiguo
    Wang, Haixia
    IET IMAGE PROCESSING, 2022, 16 (05) : 1293 - 1304