ScaNeRF: Scalable Bundle-Adjusting Neural Radiance Fields for Large-Scale Scene Rendering

被引:4
|
作者
Wu, Xiuchao [1 ]
Xu, Jiamin [2 ]
Zhang, Xin [1 ]
Bao, Hujun [1 ]
Huang, Qixing [3 ]
Shen, Yujun [4 ]
Tompkin, James [5 ]
Xu, Weiwei [1 ]
机构
[1] Zhejiang Univ, State Key Lab CAD&CG, Hangzhou, Peoples R China
[2] Hangzhou Dianzi Univ, Hangzhou, Peoples R China
[3] Univ Texas Austin, Austin, TX 78712 USA
[4] Ant Grp, Hangzhou, Peoples R China
[5] Brown Univ, Providence, RI 02912 USA
来源
ACM TRANSACTIONS ON GRAPHICS | 2023年 / 42卷 / 06期
关键词
Neural fields; NeRF; alternating direction method of multipliers; large-scale scenes;
D O I
10.1145/3618369
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
High-quality large-scale scene rendering requires a scalable representation and accurate camera poses. This research combines tile-based hybrid neural fields with parallel distributive optimization to improve bundle-adjusting neural radiance fields. The proposed method scales with a divideand-conquer strategy. We partition scenes into tiles, each with a multiresolution hash feature grid and shallow chained diffuse and specular multilayer perceptrons (MLPs). Tiles unify foreground and background via a spatial contraction function that allows both distant objects in outdoor scenes and planar reflections as virtual images outside the tile. Decomposing appearance with the specular MLP allows a specular-aware warping loss to provide a second optimization path for camera poses. We apply the alternating direction method of multipliers (ADMM) to achieve consensus among camera poses while maintaining parallel tile optimization. Experimental results show that our method outperforms state-of-the-art neural scene rendering method quality by 5%-10% in PSNR, maintaining sharp distant objects and view-dependent reflections across six indoor and outdoor scenes.
引用
收藏
页数:18
相关论文
共 50 条
  • [21] Exploring the Millennium Run - Scalable Rendering of Large-Scale Cosmological Datasets
    Fraedrich, Roland
    Schneider, Jens
    Westermann, Ruediger
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2009, 15 (06) : 1251 - 1258
  • [22] Scene-Constrained Neural Radiance Fields for High-Quality Sports Scene Rendering Based on Visual Sensor Network
    Dai, Yanran
    Li, Jing
    Zhang, Yong
    Jiang, Yuqi
    Qin, Haidong
    Zhou, Xiaoshi
    Zhang, Yidan
    Yang, Tao
    IEEE SENSORS JOURNAL, 2024, 24 (21) : 35900 - 35913
  • [23] Leveraging Neural Radiance Fields for Large-Scale 3D Reconstruction from Aerial Imagery
    Hermann, Max
    Kwak, Hyovin
    Ruf, Boitumelo
    Weinmann, Martin
    REMOTE SENSING, 2024, 16 (24)
  • [24] Research on Bundle Adjustment for Visual SLAM Under Large-Scale Scene
    Liu, Kang
    Sun, Hanxu
    Ye, Ping
    2017 4TH INTERNATIONAL CONFERENCE ON SYSTEMS AND INFORMATICS (ICSAI), 2017, : 220 - 224
  • [25] Hybrid Neural Rendering for Large-Scale Scenes with Motion Blur
    Dai, Peng
    Zhang, Yinda
    Yu, Xin
    Lyu, Xiaoyang
    Qi, Xiaojuan
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 154 - 164
  • [26] Progress in neural radiance field and its application in large-scale real-scene 3D visualization
    Zhao Q.
    She J.
    Wan Q.
    He L.
    Li S.
    Wu S.
    National Remote Sensing Bulletin, 2024, 28 (05) : 1242 - 1261
  • [27] Enhancing endoscopic scene reconstruction with color-aware inverse rendering through neural SDF and radiance fields
    Qin, Zhibao
    Chen, Qi
    Qian, Kai
    Zheng, Qinhong
    Shi, Junsheng
    Tai, Yonghang
    BIOMEDICAL OPTICS EXPRESS, 2024, 15 (06): : 3914 - 3931
  • [28] A scalable parallel software volume rendering algorithm for large-scale unstructured data
    Wangc, Kangjian
    Zheng, Yao
    COMPUTATIONAL SCIENCE - ICCS 2007, PT 1, PROCEEDINGS, 2007, 4487 : 482 - 489
  • [29] FRONTISPIECE. Enabling neural radiance fields for large-scale aerial images - From a geometric reconstruction perspective
    不详
    PHOTOGRAMMETRIC RECORD, 2024, 39 (188): : 717 - 717
  • [30] Real-time Rendering Technology of Large-scale Underwater Scene on Web Terminal
    Zhang, Ziwen
    Liu, Yijun
    Yang, Peichao
    Ye, Wujian
    Weng, Shaowei
    Liu, Tie
    Li, Yang
    JOURNAL OF COASTAL RESEARCH, 2018, : 490 - 494