SHINE-Mapping: Large-Scale 3D Mapping Using Sparse Hierarchical Implicit Neural Representations

被引:25
|
作者
Zhong, Xingguang [1 ]
Pan, Yue [1 ]
Behley, Jens [1 ]
Stachniss, Cyrill [1 ,2 ,3 ]
机构
[1] Univ Bonn, Bonn, Germany
[2] Univ Oxford, Dept Engn Sci, Oxford, England
[3] Lamarr Inst Machine Learning & Artificial Intelli, Dortmund, Germany
关键词
D O I
10.1109/ICRA48891.2023.10160907
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Accurate mapping of large-scale environments is an essential building block of most outdoor autonomous systems. Challenges of traditional mapping methods include the balance between memory consumption and mapping accuracy. This paper addresses the problem of achieving large-scale 3D reconstruction using implicit representations built from 3D LiDAR measurements. We learn and store implicit features through an octree-based, hierarchical structure, which is sparse and extensible. The implicit features can be turned into signed distance values through a shallow neural network. We leverage binary cross entropy loss to optimize the local features with the 3D measurements as supervision. Based on our implicit representation, we design an incremental mapping system with regularization to tackle the issue of forgetting in continual learning. Our experiments show that our 3D reconstructions are more accurate, complete, and memory-efficient than current state-of-the-art 3D mapping methods.
引用
收藏
页码:8371 / 8377
页数:7
相关论文
共 50 条
  • [41] Optimal and hierarchical clustering of large-scale hybrid networks for scientific mapping
    Liu, Xinhai
    Glanzel, Wolfgang
    De Moor, Bart
    SCIENTOMETRICS, 2012, 91 (02) : 473 - 493
  • [42] Optimal and hierarchical clustering of large-scale hybrid networks for scientific mapping
    Xinhai Liu
    Wolfgang Glänzel
    Bart De Moor
    Scientometrics, 2012, 91 : 473 - 493
  • [43] Surveying and mapping of large-scale 3D digital topographic map based on oblique photography technology
    Gu, Liuwan
    Zhang, Hao
    Wu, Xingjie
    JOURNAL OF RADIATION RESEARCH AND APPLIED SCIENCES, 2024, 17 (01)
  • [44] Large-Scale 3D Optical Mapping and Quantitative Analysis of Nanoparticle Distribution in Tumor Vascular Microenvironment
    Koo, Dong-Jun
    Choi, Jinahn
    Ahn, Minchul
    Ahn, Benjamin H.
    Min, Dal-Hee
    Kim, Sung-Yon
    BIOCONJUGATE CHEMISTRY, 2020, 31 (07) : 1784 - 1794
  • [45] A NEW REAL-TIME 3D DENSE SEMANTIC MAPPING SYSTEM FOR LARGE-SCALE ENVIRONMENTS
    Xing, Zhiwei
    Zhu, Xiaorui
    Wu, Yudong
    International Journal of Robotics and Automation, 2024, 39 (01) : 12 - 23
  • [46] Efficient convex optimization-based texture mapping for large-scale 3D scene reconstruction
    Sheng, Xin
    Yuan, Jing
    Tao, Wenbing
    Tao, Bo
    Liu, Liman
    INFORMATION SCIENCES, 2021, 556 : 143 - 159
  • [47] RegGeoNet: Learning Regular Representations for Large-Scale 3D Point Clouds
    Zhang, Qijian
    Hou, Junhui
    Qian, Yue
    Chan, Antoni B.
    Zhang, Juyong
    He, Ying
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2022, 130 (12) : 3100 - 3122
  • [48] RegGeoNet: Learning Regular Representations for Large-Scale 3D Point Clouds
    Qijian Zhang
    Junhui Hou
    Yue Qian
    Antoni B. Chan
    Juyong Zhang
    Ying He
    International Journal of Computer Vision, 2022, 130 : 3100 - 3122
  • [49] SNeRF: Stylized Neural Implicit Representations for 3D Scenes
    Nguyen-Phuoc, Thu
    Liu, Feng
    Xiao, Lei
    ACM TRANSACTIONS ON GRAPHICS, 2022, 41 (04):
  • [50] A novel 3D visualization tool for large-scale neural networks
    Alexander Jones
    Justin Cardoza
    Denver J Liu
    Laurence C Jayet Bray
    Sergiu M Dascalu
    Sushil J Louis
    Frederick C Harris
    BMC Neuroscience, 14 (Suppl 1)