Unbounded-GS: Extending 3D Gaussian Splatting With Hybrid Representation for Unbounded Large-Scale Scene Reconstruction

被引：0
|
作者：
Li, Wanzhang [1 ]
Yin, Fukun [1 ]
Liu, Wen [2 ]
Yang, Yiying [3 ]
Chen, Xin [2 ]
Jiang, Biao [1 ]
Yu, Gang [2 ]
Fan, Jiayuan [3 ]
机构：
[1] Fudan University, School Of Information Science And Technology, Shanghai,200433, China
[2] Platform And Content Group (PCG), Tencent, Shanghai,200030, China
[3] Fudan University, Academy For Engineering And Technology, Shanghai,200433, China
来源：
IEEE Robotics and Automation Letters | 2024年 / 9卷 / 12期
关键词：
Modeling large-scale scenes from multi-view images is challenging due to the trade-off dilemma between visual quality and computational cost. Existing NeRF-based methods have made advancements in neural implicit representation through volumetric ray-marching; but still struggle to deal with cubically growing sampling space in large-scale scenes. Fortunately; the rendering approach based on 3D Gaussian splatting (3DGS) has shown promising results; inspiring further exploration in the splatting setting. However; 3DGS has the limitation of inadequate Gaussian points for modeling distant backgrounds; leading to splotchyartifacts. To address this problem; we introduce a novel hybrid neural representation called Unbounded 3D Gaussian. For foreground area; we employs an explicit 3D Gaussian representation to efficiently model the geometry and appearance through splatting weighted Gaussians. For far-away background; we additionally introduce an implicit module comprising Multi-layer Perceptions (MLPs) to directly predict far-away background colors from positional encodings of view positions and ray directions. Furthermore; we design a seamless blending mechanism between the color predictions of the explicit splatting and implicit branches to reconstruct holistic scenes. Extensive experiments demonstrate that our proposed Unbounded-GS inherits the advantages of both faster convergence and high-fidelity rendering quality. © 2016 IEEE;
D O I：
10.1109/LRA.2024.3494652
中图分类号：
学科分类号：
摘要：
引用
收藏
页码：11529 / 11536
相关论文
共 50 条
  • [31] Neural Surfel Reconstruction: Addressing Loop Closure Challenges in Large-Scale 3D Neural Scene Mapping
    Cui, Jiadi
    Zhang, Jiajie
    Kneip, Laurent
    Schwertfeger, Sören
    Sensors, 2024, 24 (21)
  • [32] ScanComplete: Large-Scale Scene Completion and Semantic Segmentation for 3D Scans
    Dai, Angela
    Ritchie, Daniel
    Bokeloh, Martin
    Reed, Scott
    Sturm, Juergen
    Niessner, Matthias
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 4578 - 4587
  • [33] TO-Scene: A Large-Scale Dataset for Understanding 3D Tabletop Scenes
    Xu, Mutian
    Chen, Pei
    Liu, Haolin
    Han, Xiaoguang
    COMPUTER VISION - ECCV 2022, PT XXVII, 2022, 13687 : 340 - 356
  • [34] Human-centric Scene Understanding for 3D Large-scale Scenarios
    Xu, Yiteng
    Cong, Peishan
    Yao, Yichen
    Chen, Runnan
    Hou, Yuenan
    Zhu, Xinge
    He, Xuming
    Yu, Jingyi
    Ma, Yuexin
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 20292 - 20302
  • [35] Automatic global path generation for large-scale 3D scene exploration
    Che, Li
    Kang, F. J.
    INTERNATIONAL JOURNAL OF MODELING SIMULATION AND SCIENTIFIC COMPUTING, 2020, 11 (06)
  • [36] MAP Visibility Estimation for Large-Scale Dynamic 3D Reconstruction
    Joo, Hanbyul
    Park, Hyun Soo
    Sheikh, Yaser
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 1122 - 1129
  • [37] Scanning-based 3D reconstruction of large-scale objects
    Bai, Suqin
    Shi, Jinlong
    Ge, Qijie
    Tian, Zhaohui
    PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON ROBOTICS, INTELLIGENT CONTROL AND ARTIFICIAL INTELLIGENCE (RICAI 2019), 2019, : 584 - 589
  • [38] Monocular 3D scene reconstruction at absolute scale
    Woehler, Christian
    d'Angelo, Pablo
    Krueger, Lars
    Kuhl, Annika
    Gross, Horst-Michael
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2009, 64 (06) : 529 - 540
  • [39] Procedure and algorithm of 3D reconstruction of large-scale ancient architecture
    Xia Song
    Zhu Yixuan
    Li Xin
    THREE-DIMENSIONAL IMAGE CAPTURE AND APPLICATIONS VII, 2006, 6056
  • [40] Large-scale 3D chromatin reconstruction from chromosomal contacts
    Zhang, Yanlin
    Liu, Weiwei
    Lin, Yu
    Ng, Yen Kaow
    Li, Shuaicheng
    BMC GENOMICS, 2019, 20 (Suppl 2)
12345