ADAPTIVE WEIGHTED NETWORK WITH EDGE ENHANCEMENT MODULE FOR MONOCULAR SELF-SUPERVISED DEPTH ESTIMATION

被引:1
|
作者
Liu, Hong [1 ]
Zhu, Ying [1 ]
Hua, Guoliang [1 ]
Huang, Weibo [1 ]
Ding, Runwei [1 ]
机构
[1] Peking Univ, Shenzhen Grad Sch, Key Lab Machine Percept, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Monocular self-supervised depth estimation; Edge enhancement module; Texture sparsity based adaptive weighted loss;
D O I
10.1109/ICASSP43922.2022.9746689
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Monocular self-supervised depth estimation can be easily applied in many areas since only a single camera is required. However, current methods do not predict well in depth borders. Besides, factors such as occlusion and texture sparsity can lead to the failure of the photometric consistency, affecting the prediction performance. To overcome these deficiencies, an adaptive weighted monocular self-supervised depth estimation framework that exploits enhanced edge information and texture sparsity based adaptive weights is proposed. In particular, a module named edge enhancement module (EEM) is designed to be embedded into the current depth prediction network to extract edge details for clearer depth prediction in depth borders. Moreover, a texture sparsity based adaptive weighted (TSAW) loss is introduced to assign different weights according to texture sparsity, enabling a more targeted construction of geometric constraints. Experimental results on the KITTI dataset demonstrate that the proposed network outperforms state-of-the-art methods.
引用
收藏
页码:2340 / 2344
页数:5
相关论文
共 50 条
  • [1] Adaptive Self-supervised Depth Estimation in Monocular Videos
    Mendoza, Julio
    Pedrini, Helio
    [J]. IMAGE AND GRAPHICS (ICIG 2021), PT III, 2021, 12890 : 687 - 699
  • [2] Multilevel feature fusion and edge optimization network for self-supervised monocular depth estimation
    Liu, Guohua
    Niu, Shuqing
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (03)
  • [3] MonoER - A Edge Refined Self-Supervised Monocular Depth Estimation Method
    Xiang, Tianyu
    Zhao, Lingzhe
    Zhang, Hao
    Wang, Zhuping
    [J]. 2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 1074 - 1079
  • [4] Self-supervised monocular depth estimation with occlusion mask and edge awareness
    Shi Zhou
    Miaomiao Zhu
    Zhen Li
    He Li
    Mitsunori Mizumachi
    Lifeng Zhang
    [J]. Artificial Life and Robotics, 2021, 26 : 354 - 359
  • [5] Self-supervised monocular depth estimation with occlusion mask and edge awareness
    Zhou, Shi
    Zhu, Miaomiao
    Li, Zhen
    Li, He
    Mizumachi, Mitsunori
    Zhang, Lifeng
    [J]. ARTIFICIAL LIFE AND ROBOTICS, 2021, 26 (03) : 354 - 359
  • [6] RA-Depth: Resolution Adaptive Self-supervised Monocular Depth Estimation
    He, Mu
    Hui, Le
    Bian, Yikai
    Ren, Jian
    Xie, Jin
    Yang, Jian
    [J]. COMPUTER VISION - ECCV 2022, PT XXVII, 2022, 13687 : 565 - 581
  • [7] Self-supervised monocular depth estimation in fog
    Tao, Bo
    Hu, Jiaxin
    Jiang, Du
    Li, Gongfa
    Chen, Baojia
    Qian, Xinbo
    [J]. OPTICAL ENGINEERING, 2023, 62 (03)
  • [8] On the uncertainty of self-supervised monocular depth estimation
    Poggi, Matteo
    Aleotti, Filippo
    Tosi, Fabio
    Mattoccia, Stefano
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 3224 - 3234
  • [9] Revisiting Self-supervised Monocular Depth Estimation
    Kim, Ue-Hwan
    Lee, Gyeong-Min
    Kim, Jong-Hwan
    [J]. ROBOT INTELLIGENCE TECHNOLOGY AND APPLICATIONS 6, 2022, 429 : 336 - 350
  • [10] Digging Into Self-Supervised Monocular Depth Estimation
    Godard, Clement
    Mac Aodha, Oisin
    Firman, Michael
    Brostow, Gabriel
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 3827 - 3837