ATTENTION-BASED SELF-SUPERVISED LEARNING MONOCULAR DEPTH ESTIMATION WITH EDGE REFINEMENT

被引:2
|
作者
Jiang, Chenweinan [1 ]
Liu, Haichun [1 ]
Li, Lanzhen [2 ]
Pan, Changchun [1 ]
机构
[1] Shanghai Jiao Tong Univ, Key Lab Nav & Locat Based Serv, Shanghai 200240, Peoples R China
[2] Shanghai West Hongqiao Nav Technol CO LTD, Shanghai 201799, Peoples R China
关键词
self-supervised learning; monocular; depth estimation; attention; edge refinement;
D O I
10.1109/ICIP42928.2021.9506510
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Learning depth from a single image extracted from unlabeled videos has been attracting significant attention in the past few years. In this work, we propose a new depth estimation neural network with edge refinement to predict depth. First, we introduce a dual attention module into depth prediction module to integrate global information into local features and improve local features' capability of representation. Second, to increase the details between objects in scenes, we propose a subnetwork to predict edges in four directions and combine the predicted depth and edges to increase the details by propagation operation. Besides, we integrate the gradients of the image into the photometric reprojection loss to handle the confusion caused by changing brightness. We conduct experiments on KITTI datasets and show that our network achieves the state-of-art result.
引用
收藏
页码:3218 / 3222
页数:5
相关论文
共 50 条
  • [1] Channel-Wise Attention-Based Network for Self-Supervised Monocular Depth Estimation
    Yan, Jiaxing
    Zhao, Hong
    Bu, Penghui
    Jin, YuSheng
    [J]. 2021 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2021), 2021, : 464 - 473
  • [2] Self-Supervised Monocular Depth Estimation Based on Channel Attention
    Tao, Bo
    Chen, Xinbo
    Tong, Xiliang
    Jiang, Du
    Chen, Baojia
    [J]. PHOTONICS, 2022, 9 (06)
  • [3] Self-Supervised Monocular Depth Estimation With Frequency-Based Recurrent Refinement
    Li, Rui
    Xue, Danna
    Zhu, Yu
    Wu, Hao
    Sun, Jinqiu
    Zhang, Yanning
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 5626 - 5637
  • [4] MonoVAN: Visual Attention for Self-Supervised Monocular Depth Estimation
    Indyk, Ilia
    Makarov, Ilya
    [J]. 2023 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY, ISMAR, 2023, : 1211 - 1220
  • [5] Self-Supervised Learning of Monocular Depth Estimation Based on Progressive Strategy
    Wang, Huachun
    Sang, Xinzhu
    Chen, Duo
    Wang, Peng
    Yan, Binbin
    Qi, Shuai
    Ye, Xiaoqian
    Yao, Tong
    [J]. IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2021, 7 : 375 - 383
  • [6] Depth estimation algorithm of monocular image based on self-supervised learning
    Bai L.
    Liu L.-J.
    Li X.-A.
    Wu S.
    Liu R.-Q.
    [J]. Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2023, 53 (04): : 1139 - 1145
  • [7] Self-supervised Depth Completion with Attention-Based Loss
    Wang, Yingyu
    Ju, Yakun
    Jian, Muwei
    Lam, Kin-Man
    Qi, Lin
    Dong, Junyu
    [J]. INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY (IWAIT) 2020, 2020, 11515
  • [8] Self-supervised monocular image depth learning and confidence estimation
    Chen, Long
    Tang, Wen
    Wan, Tao Ruan
    John, Nigel W.
    [J]. NEUROCOMPUTING, 2020, 381 : 272 - 281
  • [9] Self-supervised Learning for Dense Depth Estimation in Monocular Endoscopy
    Liu, Xingtong
    Sinha, Ayushi
    Unberath, Mathias
    Ishii, Masaru
    Hager, Gregory D.
    Taylor, Russell H.
    Reiter, Austin
    [J]. OR 2.0 CONTEXT-AWARE OPERATING THEATERS, COMPUTER ASSISTED ROBOTIC ENDOSCOPY, CLINICAL IMAGE-BASED PROCEDURES, AND SKIN IMAGE ANALYSIS, OR 2.0 2018, 2018, 11041 : 128 - 138
  • [10] Self-supervised monocular depth estimation with occlusion mask and edge awareness
    Shi Zhou
    Miaomiao Zhu
    Zhen Li
    He Li
    Mitsunori Mizumachi
    Lifeng Zhang
    [J]. Artificial Life and Robotics, 2021, 26 : 354 - 359