Self-supervised coarse-to-fine monocular depth estimation using a lightweight attention module

被引:8
|
作者
Li, Yuanzhen [1 ]
Luo, Fei [1 ]
Xiao, Chunxia [1 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Peoples R China
基金
中国国家自然科学基金;
关键词
monocular depth estimation; texture copy; depth drift; attention module; PREDICTION; SLAM;
D O I
10.1007/s41095-022-0279-3
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Self-supervised monocular depth estimation has been widely investigated and applied in previous works. However, existing methods suffer from texture-copy, depth drift, and incomplete structure. It is difficult for normal CNN networks to completely understand the relationship between the object and its surrounding environment. Moreover, it is hard to design the depth smoothness loss to balance depth smoothness and sharpness. To address these issues, we propose a coarse-to-fine method with a normalized convolutional block attention module (NCBAM). In the coarse estimation stage, we incorporate the NCBAM into depth and pose networks to overcome the texture-copy and depth drift problems. Then, we use a new network to refine the coarse depth guided by the color image and produce a structure-preserving depth result in the refinement stage. Our method can produce results competitive with state-of-the-art methods. Comprehensive experiments prove the effectiveness of our two-stage method using the NCBAM.
引用
收藏
页码:631 / 647
页数:17
相关论文
共 50 条
  • [21] Joint Soft-Hard Attention for Self-Supervised Monocular Depth Estimation
    Fan, Chao
    Yin, Zhenyu
    Xu, Fulong
    Chai, Anying
    Zhang, Feiqing
    SENSORS, 2021, 21 (21)
  • [22] SQLdepth: Generalizable Self-Supervised Fine-Structured Monocular Depth Estimation
    Wang, Youhong
    Liang, Yunji
    Xu, Hao
    Jiao, Shaohui
    Yu, Hongkai
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 6, 2024, : 5713 - 5721
  • [23] RENA-Depth: toward recursion representation enhancement in neighborhood attention guided lightweight self-supervised monocular depth estimation
    Yang, Chaochao
    Lu, Yuanyao
    Qiu, Yongsheng
    Wang, Yuantao
    OPTICAL ENGINEERING, 2024, 63 (08)
  • [24] Lightweight Self-supervised Monocular Depth Estimation Method with Enhanced Direction-aware
    Cheng, Deqiang
    Xu, Shuai
    Lü, Chen
    Han, Chenggong
    Jiang, He
    Kou, Qiqi
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2024, 46 (09): : 3683 - 3692
  • [25] Eite-Mono: An Extreme Lightweight Architecture for Self-Supervised Monocular Depth Estimation
    Ren, Chaopeng
    IEEE Access, 2024, 12 : 167010 - 167021
  • [26] Chfnet: a coarse-to-fine hierarchical refinement model for monocular depth estimation
    Chen, Han
    Wang, Yongxiong
    MACHINE VISION AND APPLICATIONS, 2024, 35 (04)
  • [27] ADAPTIVE WEIGHTED NETWORK WITH EDGE ENHANCEMENT MODULE FOR MONOCULAR SELF-SUPERVISED DEPTH ESTIMATION
    Liu, Hong
    Zhu, Ying
    Hua, Guoliang
    Huang, Weibo
    Ding, Runwei
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2340 - 2344
  • [28] Semantically guided self-supervised monocular depth estimation
    Lu, Xiao
    Sun, Haoran
    Wang, Xiuling
    Zhang, Zhiguo
    Wang, Haixia
    IET IMAGE PROCESSING, 2022, 16 (05) : 1293 - 1304
  • [29] Self-Supervised Monocular Scene Decomposition and Depth Estimation
    Safadoust, Sadra
    Guney, Fatma
    2021 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2021), 2021, : 627 - 636
  • [30] Joint Self-Supervised Monocular Depth Estimation and SLAM
    Xing, Xiaoxia
    Cai, Yinghao
    Lu, Tao
    Yang, Yiping
    Wen, Dayong
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 4030 - 4036