ScaNeRF: Scalable Bundle-Adjusting Neural Radiance Fields for Large-Scale Scene Rendering

被引:4
|
作者
Wu, Xiuchao [1 ]
Xu, Jiamin [2 ]
Zhang, Xin [1 ]
Bao, Hujun [1 ]
Huang, Qixing [3 ]
Shen, Yujun [4 ]
Tompkin, James [5 ]
Xu, Weiwei [1 ]
机构
[1] Zhejiang Univ, State Key Lab CAD&CG, Hangzhou, Peoples R China
[2] Hangzhou Dianzi Univ, Hangzhou, Peoples R China
[3] Univ Texas Austin, Austin, TX 78712 USA
[4] Ant Grp, Hangzhou, Peoples R China
[5] Brown Univ, Providence, RI 02912 USA
来源
ACM TRANSACTIONS ON GRAPHICS | 2023年 / 42卷 / 06期
关键词
Neural fields; NeRF; alternating direction method of multipliers; large-scale scenes;
D O I
10.1145/3618369
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
High-quality large-scale scene rendering requires a scalable representation and accurate camera poses. This research combines tile-based hybrid neural fields with parallel distributive optimization to improve bundle-adjusting neural radiance fields. The proposed method scales with a divideand-conquer strategy. We partition scenes into tiles, each with a multiresolution hash feature grid and shallow chained diffuse and specular multilayer perceptrons (MLPs). Tiles unify foreground and background via a spatial contraction function that allows both distant objects in outdoor scenes and planar reflections as virtual images outside the tile. Decomposing appearance with the specular MLP allows a specular-aware warping loss to provide a second optimization path for camera poses. We apply the alternating direction method of multipliers (ADMM) to achieve consensus among camera poses while maintaining parallel tile optimization. Experimental results show that our method outperforms state-of-the-art neural scene rendering method quality by 5%-10% in PSNR, maintaining sharp distant objects and view-dependent reflections across six indoor and outdoor scenes.
引用
收藏
页数:18
相关论文
共 50 条
  • [41] City-on-Web: Real-Time Neural Rendering of Large-Scale Scenes on the Web
    Song, Kaiwen
    Zhang, Xiaoyi
    Ren, Chenqu
    Zhang, Juyong
    COMPUTER VISION - ECCV 2024, PT XLVII, 2025, 15105 : 385 - 402
  • [42] Multi-tiling neural radiance field (NeRF)-geometric assessment on large-scale aerial datasets
    Xu, Ningli
    Qin, Rongjun
    Huang, Debao
    Remondino, Fabio
    PHOTOGRAMMETRIC RECORD, 2024, 39 (188): : 718 - 740
  • [43] SPARF: Large-Scale Learning of 3D Sparse Radiance Fields from Few Input Images
    Hamdi, Abdullah
    Ghanem, Bernard
    Niessner, Matthias
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW, 2023, : 2922 - 2932
  • [44] Research on Real-Time Multi-dimensional Rendering Method of Fluid Phenomenon in Large-Scale Virtual Scene
    He, Zhengwei
    Su, Kehua
    APPLIED INFORMATICS AND COMMUNICATION, PT 2, 2011, 225 : 271 - +
  • [45] Research on real-time multi-dimensional rendering method of fluid phenomenon in large-scale virtual scene
    He Zhengwei
    Su Kehua
    2010 THE 3RD INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND INDUSTRIAL APPLICATION (PACIIA2010), VOL II, 2010, : 156 - 159
  • [46] Learning Large-scale Neural Fields via Context Pruned Meta-Learning
    Tack, Jihoon
    Kim, Subin
    Yu, Sihyun
    Lee, Jaeho
    Shin, Jinwoo
    Schwarz, Jonathan
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [47] Neural Surfel Reconstruction: Addressing Loop Closure Challenges in Large-Scale 3D Neural Scene Mapping
    Cui, Jiadi
    Zhang, Jiajie
    Kneip, Laurent
    Schwertfeger, Soren
    SENSORS, 2024, 24 (21)
  • [48] Solving large-scale variational inequalities with dynamically adjusting initial condition in physics-informed neural networks
    Wu, Dawen
    Chamoin, Ludovic
    Lisser, Abdel
    COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2024, 429
  • [49] Multi-core bundle adjustment algorithm using parallel processing in large-scale 3D scene reconstruction
    Tong, Guo-Feng
    Jiang, Zhao-Yan
    Ye, Ning
    Xu, Xin-He
    Tong, G.-F. (tongguofeng@ise.neu.edu.cn), 1600, Northeast University (28): : 1403 - 1408
  • [50] Large-Scale Stochastic Scene Generation and Semantic Annotation for Deep Convolutional Neural Network Training in the RoboCup SPL
    Hess, Timm
    Mundt, Martin
    Weis, Tobias
    Ramesh, Visvanathan
    ROBOCUP 2017: ROBOT WORLD CUP XXI, 2018, 11175 : 33 - 44