SHINE-Mapping: Large-Scale 3D Mapping Using Sparse Hierarchical Implicit Neural Representations

被引:25
|
作者
Zhong, Xingguang [1 ]
Pan, Yue [1 ]
Behley, Jens [1 ]
Stachniss, Cyrill [1 ,2 ,3 ]
机构
[1] Univ Bonn, Bonn, Germany
[2] Univ Oxford, Dept Engn Sci, Oxford, England
[3] Lamarr Inst Machine Learning & Artificial Intelli, Dortmund, Germany
关键词
D O I
10.1109/ICRA48891.2023.10160907
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Accurate mapping of large-scale environments is an essential building block of most outdoor autonomous systems. Challenges of traditional mapping methods include the balance between memory consumption and mapping accuracy. This paper addresses the problem of achieving large-scale 3D reconstruction using implicit representations built from 3D LiDAR measurements. We learn and store implicit features through an octree-based, hierarchical structure, which is sparse and extensible. The implicit features can be turned into signed distance values through a shallow neural network. We leverage binary cross entropy loss to optimize the local features with the 3D measurements as supervision. Based on our implicit representation, we design an incremental mapping system with regularization to tackle the issue of forgetting in continual learning. Our experiments show that our 3D reconstructions are more accurate, complete, and memory-efficient than current state-of-the-art 3D mapping methods.
引用
收藏
页码:8371 / 8377
页数:7
相关论文
共 50 条
  • [1] Decomposition of Neural Discrete Representations for Large-Scale 3D Mapping
    Park, Minseong
    Woo, Suhan
    Kim, Euntai
    COMPUTER VISION - ECCV 2024, PT LXXII, 2025, 15130 : 360 - 376
  • [2] Sea-SHINE: Semantic-Aware 3D Neural Mapping Using Implicit Representations
    Bezuglyj, V.
    Yudin, D. A.
    OPTICAL MEMORY AND NEURAL NETWORKS, 2024, 33 (SUPPL3) : S445 - S456
  • [3] Large-scale 3D Semantic Mapping Using Stereo Vision
    Yang, Yi
    Qiu, Fan
    Li, Hao
    Zhang, Lu
    Wang, Mei-Ling
    Fu, Meng-Yin
    INTERNATIONAL JOURNAL OF AUTOMATION AND COMPUTING, 2018, 15 (02) : 194 - 206
  • [4] Large-scale 3D Semantic Mapping Using Stereo Vision
    Yi Yang
    Fan Qiu
    Hao Li
    Lu Zhang
    Mei-Ling Wang
    Meng-Yin Fu
    International Journal of Automation and Computing, 2018, 15 (02) : 194 - 206
  • [5] Large-scale 3D mapping of the intergalactic medium using the Lyman α forest
    Ozbek, Melih
    Croft, Rupert A. C.
    Khandai, Nishikanta
    MONTHLY NOTICES OF THE ROYAL ASTRONOMICAL SOCIETY, 2016, 456 (04) : 3610 - 3623
  • [6] Neural Surfel Reconstruction: Addressing Loop Closure Challenges in Large-Scale 3D Neural Scene Mapping
    Cui, Jiadi
    Zhang, Jiajie
    Kneip, Laurent
    Schwertfeger, Soren
    SENSORS, 2024, 24 (21)
  • [7] Large-Scale Shape Retrieval with Sparse 3D Convolutional Neural Networks
    Notchenko, Alexandr
    Kapushev, Yermek
    Burnaev, Evgeny
    ANALYSIS OF IMAGES, SOCIAL NETWORKS AND TEXTS, AIST 2017, 2018, 10716 : 245 - 254
  • [8] N3-Mapping: Normal Guided Neural Non-Projective Signed Distance Fields for Large-Scale 3D Mapping
    Song, Shuangfu
    Zhao, Junqiao
    Huang, Kai
    Lin, Jiaye
    Ye, Chen
    Feng, Tiantian
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (06): : 5935 - 5942
  • [9] Nuvo: Neural UV Mapping for Unruly 3D Representations
    Srinivasan, Pratul P.
    Garbin, Stephan J.
    Verbin, Dor
    Barron, Jonathan T.
    Mildenhall, Ben
    COMPUTER VISION - ECCV 2024, PT XXXIX, 2025, 15097 : 18 - 34
  • [10] Towards Large-Scale Incremental Dense Mapping using Robot-centric Implicit Neural Representation
    Liu, Jianheng
    Chen, Haoyao
    2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2024, 2024, : 4045 - 4051