Adaptive Self-supervised Depth Estimation in Monocular Videos

被引:0
|
作者
Mendoza, Julio [1 ]
Pedrini, Helio [1 ]
机构
[1] Univ Estadual Campinas, Inst Comp, BR-13083852 Campinas, SP, Brazil
来源
基金
巴西圣保罗研究基金会;
关键词
Depth estimation; View synthesis; Monocular videos;
D O I
10.1007/978-3-030-87361-5_56
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this work, we develop and evaluate two adaptive strategies to self-supervised depth estimation methods based on view reconstruction. First, we propose an adaptive consistency loss that extends the usage of minimum re-projection to enforce consistency on the pixel intensities, structure, and feature maps. Moreover, we evaluate two approaches to use uncertainty to weigh the error contribution in the input frames. Finally, we improve our model with a composite visibility mask. The results show that the adaptive consistency loss can effectively combine photometric, structure and feature consistency terms. Moreover, weighting the error contribution using uncertainty can improve the performance of a simpler version of the model, but cannot improve them model when all improvements are considered. Finally, our combined model achieves competitive results when compared to state-of-the-art methods.
引用
收藏
页码:687 / 699
页数:13
相关论文
共 50 条
  • [41] Excavating the Potential Capacity of Self-Supervised Monocular Depth Estimation
    Peng, Rui
    Wang, Ronggang
    Lai, Yawen
    Tang, Luyang
    Cai, Yangang
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 15540 - 15549
  • [42] A LIGHTWEIGHT SELF-SUPERVISED TRAINING FRAMEWORK FOR MONOCULAR DEPTH ESTIMATION
    Heydrich, Tim
    Yang, Yimin
    Du, Shan
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2265 - 2269
  • [43] Transferring knowledge from monocular completion for self-supervised monocular depth estimation
    Sun, Lin
    Li, Yi
    Liu, Bingzheng
    Xu, Liying
    Zhang, Zhe
    Zhu, Jie
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (29) : 42485 - 42495
  • [44] Transferring knowledge from monocular completion for self-supervised monocular depth estimation
    Lin Sun
    Yi Li
    Bingzheng Liu
    Liying Xu
    Zhe Zhang
    Jie Zhu
    [J]. Multimedia Tools and Applications, 2022, 81 : 42485 - 42495
  • [45] Self-Supervised Monocular Depth Hints
    Watson, Jamie
    Firman, Michael
    Brostow, Gabriel J.
    Turmukhambetov, Daniyar
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 2162 - 2171
  • [46] Self-Supervised Monocular Depth Underwater
    Amitai, Shlomi
    Klein, Itzik
    Treibitz, Tali
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, : 1098 - 1104
  • [47] Adv-Depth: Self-Supervised Monocular Depth Estimation With an Adversarial Loss
    Li, Kunhong
    Fu, Zhiheng
    Wang, Hanyun
    Chen, Zonghao
    Guo, Yulan
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2021, 28 : 638 - 642
  • [48] HR-Depth: High Resolution Self-Supervised Monocular Depth Estimation
    Lyu, Xiaoyang
    Liu, Liang
    Wang, Mengmeng
    Kong, Xin
    Liu, Lina
    Liu, Yong
    Chen, Xinxin
    Yuan, Yi
    [J]. THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2294 - 2301
  • [49] Self-Supervised Monocular Depth Estimation With Self-Perceptual Anomaly Handling
    Zhang, Yourun
    Gong, Maoguo
    Zhang, Mingyang
    Li, Jianzhao
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 35 (12) : 1 - 15
  • [50] Self-distilled Feature Aggregation for Self-supervised Monocular Depth Estimation
    Zhou, Zhengming
    Dong, Qiulei
    [J]. COMPUTER VISION - ECCV 2022, PT I, 2022, 13661 : 709 - 726