The Constraints between Edge Depth and Uncertainty for Monocular Depth Estimation

被引:1
|
作者
Wu, Shouying [1 ]
Li, Wei [2 ]
Liang, Binbin [2 ]
Huang, Guoxin [1 ]
机构
[1] Sichuan Univ, Natl Key Lab Fundamental Sci Synthet Vis, Chengdu 610065, Peoples R China
[2] Sichuan Univ, Sch Aeronut & Astronaut, Chengdu 610065, Peoples R China
关键词
monocular depth estimation; self-supervised method; uncertainty estimation; VISION;
D O I
10.3390/electronics10243153
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The self-supervised monocular depth estimation paradigm has become an important branch of computer vision depth-estimation tasks. However, the depth estimation problem arising from object edge depth pulling or occlusion is still unsolved. The grayscale discontinuity of object edges leads to a relatively high depth uncertainty of pixels in these regions. We improve the geometric edge prediction results by taking uncertainty into account in the depth-estimation task. To this end, we explore how uncertainty affects this task and propose a new self-supervised monocular depth estimation technique based on multi-scale uncertainty. In addition, we introduce a teacher-student architecture in models and investigate the impact of different teacher networks on the depth and uncertainty results. We evaluate the performance of our paradigm in detail on the standard KITTI dataset. The experimental results show that the accuracy of our method increased from 87.7% to 88.2%, the AbsRel error rate decreased from 0.115 to 0.11, the SqRel error rate decreased from 0.903 to 0.822, and the RMSE error rate decreased from 4.863 to 4.686 compared with the benchmark Monodepth2. Our approach has a positive impact on the problem of texture replication or inaccurate object boundaries, producing sharper and smoother depth images.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Self-supervised Monocular Depth Estimation Based on Semantic Assistance and Depth Temporal Consistency Constraints
    Ling, Chuanwu
    Chen, Hua
    Xu, Dayong
    Zhang, Xiaogang
    Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2024, 51 (08): : 1 - 12
  • [32] Constant Velocity Constraints for Self-Supervised Monocular Depth Estimation
    Zhou, Hang
    Greenwood, David
    Taylor, Sarah
    Gong, Han
    CVMP 2020: THE 17TH ACM SIGGRAPH EUROPEAN CONFERENCE ON VISUAL MEDIA PRODUCTION, 2020,
  • [33] Edge Enhancement in Monocular Depth Prediction
    Yue, Haosong
    Zhang, Jinqing
    Wu, Xingming
    Wang, Jianhua
    Chen, Weihai
    PROCEEDINGS OF THE 15TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA 2020), 2020, : 1594 - 1599
  • [34] Self-supervised Monocular Depth Estimation with Uncertainty-aware Feature Enhancement and Depth Fusion
    Li, Jiahui
    Wang, Zhicheng
    Sun, Kaiwei
    2024 INTERNATIONAL CONFERENCE ON ELECTRONIC ENGINEERING AND INFORMATION SYSTEMS, EEISS 2024, 2024, : 55 - 61
  • [35] LightDepthNet: Lightweight CNN Architecture for Monocular Depth Estimation on Edge Devices
    Liu, Qingliang
    Zhou, Shuai
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2024, 71 (04) : 2389 - 2393
  • [36] Asymmetric Edge-Aware Transformers for Monocular Endoscopic Depth Estimation
    Wu, Ming
    Qi, Hao
    Fan, Wenkang
    Ke, Sunkui
    Zeng, Hui-Qing
    Chen, Yinran
    Luo, Xiongbiao
    IMAGE-GUIDED PROCEDURES, ROBOTIC INTERVENTIONS, AND MODELING, MEDICAL IMAGING 2024, 2024, 12928
  • [37] Depth Estimation from Monocular Vision using Image Edge Complexity
    Haris, Sallehuddin Mohamed
    Zakaria, Muhammad Khalid
    Nuawi, Mohd Zaki
    2011 IEEE/ASME INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS (AIM), 2011, : 868 - 873
  • [38] A lightweight network for monocular depth estimation with decoupled body and edge supervision
    Ali, Usman
    Bayramli, Bayram
    Alsarhan, Tamam
    Lu, Hongtao
    IMAGE AND VISION COMPUTING, 2021, 113
  • [39] DTTNet: Depth Transverse Transformer Network for Monocular Depth Estimation
    Kamath, Shreyas K. M.
    Rajeev, Srijith
    Panetta, Karen
    Agaian, Sos S.
    MULTIMODAL IMAGE EXPLOITATION AND LEARNING 2022, 2022, 12100
  • [40] Depth-Relative Self Attention for Monocular Depth Estimation
    Shim, Kyuhong
    Kim, Jiyoung
    Lee, Gusang
    Shim, Byonghyo
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 1396 - 1404