Self-Supervised Monocular Depth Estimation with Multi-constraints

被引:0
|
作者
Yang, Xinpeng [1 ]
Zhang, Sen [1 ,2 ]
Zhao, Baoyong [1 ,2 ]
机构
[1] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100083, Peoples R China
[2] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Key Lab Knowledge Automat Ind Proc, Minist Educ, Beijing 100083, Peoples R China
关键词
self-supervised; depth estimation; ASPP; photometric loss; spatial loss;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
For the self-supervised image depth estimation algorithm based on deep learning, the characteristics of self-supervised methods cause some problems such as visual shadow and infinity estimation. This paper tackles these problems by adopting the spatial consistency loss and multiple loss constraints. In this paper, the depth estimated network and pose estimated network are trained by binocular image sequence. And the depth estimated problem is transformed into image reconstruction and scene reconstruction to realize self-supervised training. Based on the Deep Convolutional Neural Networks(DCNN), the depth estimated network introduces the Deep Atrous Convolution (DAC) and the Atrous Spatial Pyramid Pooling (ASPP) modules to extract the multi-scale feature and increase the receptive field of the network. The spatial consistency of scene reconstruction strategy greatly reduces the estimated error of pose network. The quantitative and qualitative evaluation on the KITTI dataset shows that the proposed algorithm outperforms the existing self-supervised depth estimation algorithms in accuracy and error, even exceeds most of the supervised algorithms.
引用
收藏
页码:8422 / 8427
页数:6
相关论文
共 50 条
  • [1] Constant Velocity Constraints for Self-Supervised Monocular Depth Estimation
    Zhou, Hang
    Greenwood, David
    Taylor, Sarah
    Gong, Han
    [J]. CVMP 2020: THE 17TH ACM SIGGRAPH EUROPEAN CONFERENCE ON VISUAL MEDIA PRODUCTION, 2020,
  • [2] Digging Into Self-Supervised Monocular Depth Estimation
    Godard, Clement
    Mac Aodha, Oisin
    Firman, Michael
    Brostow, Gabriel
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 3827 - 3837
  • [3] On the uncertainty of self-supervised monocular depth estimation
    Poggi, Matteo
    Aleotti, Filippo
    Tosi, Fabio
    Mattoccia, Stefano
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 3224 - 3234
  • [4] Revisiting Self-supervised Monocular Depth Estimation
    Kim, Ue-Hwan
    Lee, Gyeong-Min
    Kim, Jong-Hwan
    [J]. ROBOT INTELLIGENCE TECHNOLOGY AND APPLICATIONS 6, 2022, 429 : 336 - 350
  • [5] Self-supervised monocular depth estimation in fog
    Tao, Bo
    Hu, Jiaxin
    Jiang, Du
    Li, Gongfa
    Chen, Baojia
    Qian, Xinbo
    [J]. OPTICAL ENGINEERING, 2023, 62 (03)
  • [6] Multi-resolution distillation for self-supervised monocular depth estimation
    Lee, Sebin
    Im, Woobin
    Yoon, Sung-Eui
    [J]. PATTERN RECOGNITION LETTERS, 2023, 176 : 215 - 222
  • [7] Multi-resolution distillation for self-supervised monocular depth estimation
    Lee, Sebin
    Im, Woobin
    Yoon, Sung-Eui
    [J]. PATTERN RECOGNITION LETTERS, 2023, 176
  • [8] Enhancing Self-supervised Monocular Depth Estimation via Incorporating Robust Constraints
    Li, Rui
    He, Xiantuo
    Zhu, Yu
    Li, Xianjun
    Sun, Jinqiu
    Zhang, Yanning
    [J]. MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 3108 - 3117
  • [9] Semantically guided self-supervised monocular depth estimation
    Lu, Xiao
    Sun, Haoran
    Wang, Xiuling
    Zhang, Zhiguo
    Wang, Haixia
    [J]. IET IMAGE PROCESSING, 2022, 16 (05) : 1293 - 1304
  • [10] Joint Self-Supervised Monocular Depth Estimation and SLAM
    Xing, Xiaoxia
    Cai, Yinghao
    Lu, Tao
    Yang, Yiping
    Wen, Dayong
    [J]. 2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 4030 - 4036