An Efficient Information-Reinforced Lidar Deep Completion Network without RGB Guided

被引:2
|
作者
Wei, Ming [1 ,2 ]
Zhu, Ming [1 ]
Zhang, Yaoyuan [1 ,2 ]
Sun, Jiaqi [1 ,2 ]
Wang, Jiarong [1 ]
机构
[1] Chinese Acad Sci, Changchun Inst Opt Fine Mech & Phys, Changchun 130033, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
关键词
depth completion; lidar data processing; image processing; deep learning;
D O I
10.3390/rs14194689
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Due to the sparsity of point clouds obtained by LIDAR, the depth information is usually not complete and dense. The depth completion task is to recover dense depth information from sparse depth information. However, most of the current deep completion networks use RGB images as guidance, which are more like a processing method of information fusion. They are not valid when there is only sparse depth data and no other color information. Therefore, this paper proposes an information-reinforced completion network for a single sparse depth input. We use a multi-resolution dense progressive fusion structure to maximize the multi-scale information and optimize the global situation by point folding. At the same time, we re-aggregate the confidence and impose another depth constraint on the pixel depth to make the depth estimation closer to the ground trues. Our experimental results on KITTI and NYU Depth v2 datasets show that the proposed network achieves better results than other unguided deep completion methods. And it is excellent in both accuracy and real-time performance.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Unsupervised deep depth completion with heterogeneous LiDAR and RGB-D camera depth information
    Gou, Guohua
    Li, Han
    Wang, Xuanhao
    Zhang, Hao
    Yang, Wei
    Sui, Haigang
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2025, 136
  • [2] DFuseNet: Deep Fusion of RGB and Sparse Depth Information for Image Guided Dense Depth Completion
    Shivakumar, Shreyas S.
    Ty Nguyen
    Miller, Ian D.
    Chen, Steven W.
    Kumar, Vijay
    Taylor, Camillo J.
    2019 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2019, : 13 - 20
  • [3] Decomposed Guided Dynamic Filters for Efficient RGB-Guided Depth Completion
    Wang, Yufei
    Mao, Yuxin
    Liu, Qi
    Dai, Yuchao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (02) : 1186 - 1198
  • [4] Self Attention Guided Depth Completion using RGB and Sparse LiDAR Point Clouds
    Srivastava, Siddharth
    Sharma, Gaurav
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 2643 - 2650
  • [5] An adaptive converged depth completion network based on efficient RGB guidance
    Kaixiang Liu
    Qingwu Li
    Yaqin Zhou
    Multimedia Tools and Applications, 2022, 81 : 35915 - 35933
  • [6] An adaptive converged depth completion network based on efficient RGB guidance
    Liu, Kaixiang
    Li, Qingwu
    Zhou, Yaqin
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (25) : 35915 - 35933
  • [7] Deep Adversarial Completion for Sparse Heterogeneous Information Network Embedding
    Zhao, Kai
    Bai, Ting
    Wu, Bin
    Wang, Bai
    Zhang, Youjie
    Yang, Yuanyu
    Nie, Jian-Yun
    WEB CONFERENCE 2020: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2020), 2020, : 508 - 518
  • [8] Spatial Information-Guided Adaptive Context-Aware Network for Efficient RGB-D Semantic Segmentation
    Zhang, Yang
    Xiong, Chenyun
    Liu, Junjie
    Ye, Xuhui
    Sun, Guodong
    IEEE SENSORS JOURNAL, 2023, 23 (19) : 23512 - 23521
  • [9] A Two-stage hybrid CNN-Transformer Network for RGB Guided Indoor Depth Completion
    Deng, Yufan
    Deng, Xin
    Xu, Mai
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 1127 - 1132
  • [10] When Face Completion Meets Irregular Holes: An Attributes Guided Deep Inpainting Network
    Xiao, Jie
    Zhan, Dandan
    Qi, Haoran
    Jin, Zhi
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3202 - 3210