ATTENTION-BASED SELF-SUPERVISED LEARNING MONOCULAR DEPTH ESTIMATION WITH EDGE REFINEMENT

被引:2
|
作者
Jiang, Chenweinan [1 ]
Liu, Haichun [1 ]
Li, Lanzhen [2 ]
Pan, Changchun [1 ]
机构
[1] Shanghai Jiao Tong Univ, Key Lab Nav & Locat Based Serv, Shanghai 200240, Peoples R China
[2] Shanghai West Hongqiao Nav Technol CO LTD, Shanghai 201799, Peoples R China
关键词
self-supervised learning; monocular; depth estimation; attention; edge refinement;
D O I
10.1109/ICIP42928.2021.9506510
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Learning depth from a single image extracted from unlabeled videos has been attracting significant attention in the past few years. In this work, we propose a new depth estimation neural network with edge refinement to predict depth. First, we introduce a dual attention module into depth prediction module to integrate global information into local features and improve local features' capability of representation. Second, to increase the details between objects in scenes, we propose a subnetwork to predict edges in four directions and combine the predicted depth and edges to increase the details by propagation operation. Besides, we integrate the gradients of the image into the photometric reprojection loss to handle the confusion caused by changing brightness. We conduct experiments on KITTI datasets and show that our network achieves the state-of-art result.
引用
下载
收藏
页码:3218 / 3222
页数:5
相关论文
共 50 条
  • [21] Joint Soft-Hard Attention for Self-Supervised Monocular Depth Estimation
    Fan, Chao
    Yin, Zhenyu
    Xu, Fulong
    Chai, Anying
    Zhang, Feiqing
    SENSORS, 2021, 21 (21)
  • [22] SENSE: Self-Evolving Learning for Self-Supervised Monocular Depth Estimation
    Li, Guanbin
    Huang, Ricong
    Li, Haofeng
    You, Zunzhi
    Chen, Weikai
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 439 - 450
  • [23] Self-supervised learning monocular depth estimation from internet photos
    Lin, Xiaocan
    Li, Nan
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 99
  • [24] Dense Depth Estimation in Monocular Endoscopy With Self-Supervised Learning Methods
    Liu, Xingtong
    Sinha, Ayushi
    Ishii, Masaru
    Hager, Gregory D.
    Reiter, Austin
    Taylor, Russell H.
    Unberath, Mathias
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (05) : 1438 - 1447
  • [25] Self-Supervised Monocular Depth Estimation: Solving the Edge-Fattening Problem
    Chen, Xingyu
    Zhang, Ruonan
    Jiang, Ji
    Wang, Yan
    Li, Ge
    Li, Thomas H.
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 5765 - 5775
  • [26] Dual-attention-based semantic-aware self-supervised monocular depth estimation
    Xu, Jinze
    Ye, Feng
    Lai, Yizong
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (24) : 65579 - 65601
  • [27] Self-Supervised Monocular Depth Estimation With Self-Reference Distillation and Disparity Offset Refinement
    Liu, Zhong
    Li, Ran
    Shao, Shuwei
    Wu, Xingming
    Chen, Weihai
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (12) : 7565 - 7577
  • [28] Monocular depth estimation for vision-based vehicles based on a self-supervised learning method
    Tektonidis, Marco
    Monnin, David
    AUTONOMOUS SYSTEMS: SENSORS, PROCESSING, AND SECURITY FOR VEHICLES AND INFRASTRUCTURE 2020, 2020, 11415
  • [29] LAM-Depth: Laplace-Attention Module-Based Self-Supervised Monocular Depth Estimation
    Wei, Jiansheng
    Pan, Shuguo
    Gao, Wang
    Guo, Peng
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, : 1 - 11
  • [30] Online supervised attention-based recurrent depth estimation from monocular video
    Maslov, Dmitrii
    Makarov, Ilya
    PEERJ COMPUTER SCIENCE, 2020,