ScaNeRF: Scalable Bundle-Adjusting Neural Radiance Fields for Large-Scale Scene Rendering

被引:4
|
作者
Wu, Xiuchao [1 ]
Xu, Jiamin [2 ]
Zhang, Xin [1 ]
Bao, Hujun [1 ]
Huang, Qixing [3 ]
Shen, Yujun [4 ]
Tompkin, James [5 ]
Xu, Weiwei [1 ]
机构
[1] Zhejiang Univ, State Key Lab CAD&CG, Hangzhou, Peoples R China
[2] Hangzhou Dianzi Univ, Hangzhou, Peoples R China
[3] Univ Texas Austin, Austin, TX 78712 USA
[4] Ant Grp, Hangzhou, Peoples R China
[5] Brown Univ, Providence, RI 02912 USA
来源
ACM TRANSACTIONS ON GRAPHICS | 2023年 / 42卷 / 06期
关键词
Neural fields; NeRF; alternating direction method of multipliers; large-scale scenes;
D O I
10.1145/3618369
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
High-quality large-scale scene rendering requires a scalable representation and accurate camera poses. This research combines tile-based hybrid neural fields with parallel distributive optimization to improve bundle-adjusting neural radiance fields. The proposed method scales with a divideand-conquer strategy. We partition scenes into tiles, each with a multiresolution hash feature grid and shallow chained diffuse and specular multilayer perceptrons (MLPs). Tiles unify foreground and background via a spatial contraction function that allows both distant objects in outdoor scenes and planar reflections as virtual images outside the tile. Decomposing appearance with the specular MLP allows a specular-aware warping loss to provide a second optimization path for camera poses. We apply the alternating direction method of multipliers (ADMM) to achieve consensus among camera poses while maintaining parallel tile optimization. Experimental results show that our method outperforms state-of-the-art neural scene rendering method quality by 5%-10% in PSNR, maintaining sharp distant objects and view-dependent reflections across six indoor and outdoor scenes.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] BARF : Bundle-Adjusting Neural Radiance Fields
    Lin, Chen-Hsuan
    Ma, Wei-Chiu
    Torralba, Antonio
    Lucey, Simon
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5721 - 5731
  • [2] DBARF: Deep Bundle-Adjusting Generalizable Neural Radiance Fields
    Chen, Yu
    Lee, Gim Hee
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 24 - 34
  • [3] Adaptive Positional Encoding for Bundle-Adjusting Neural Radiance Fields
    Gao, Zelin
    Dai, Weichen
    Zhang, Yu
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 3261 - 3271
  • [4] Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fields
    Chen, Yue
    Chen, Xingyu
    Wang, Xuan
    Zhang, Qi
    Guo, Yu
    Shan, Ying
    Wang, Fci
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 8264 - 8273
  • [5] Visual-Inertial Odometry Priors for Bundle-Adjusting Neural Radiance Fields
    Kim, Hyunjin
    Song, Minkyeong
    Lee, Daekyeong
    Kim, Pyojin
    2022 22ND INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2022), 2022, : 1131 - 1136
  • [6] CBARF: Cascaded Bundle-Adjusting Neural Radiance Fields From Imperfect Camera Poses
    Fu, Hongyu
    Yu, Xin
    Li, Lincheng
    Zhang, Li
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 9304 - 9315
  • [7] RPE-BARF: Relative Pose Estimation for Robust Bundle-Adjusting Neural Radiance Fields
    Zhou, Fan
    Wang, Jiayi
    Zhou, Xiang
    Zhang, Weichen
    Li, Zhiheng
    ACM International Conference Proceeding Series,
  • [8] RPE-BARF: Relative Pose Estimation for Robust Bundle-Adjusting Neural Radiance Fields
    Fan, Zhou
    Wang Jiayi
    Xiang, Zhou
    Zhang Weichen
    Li, Zhiheng
    2024 2ND ASIA CONFERENCE ON COMPUTER VISION, IMAGE PROCESSING AND PATTERN RECOGNITION, CVIPPR 2024, 2024,
  • [9] NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstruction
    Zhang, Xiaoshuai
    Bi, Sai
    Sunkavalli, Kalyan
    Su, Hao
    Xu, Zexiang
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5439 - 5448
  • [10] AG-NeRF: Attention-Guided Neural Radiance Fields for Multi-height Large-Scale Outdoor Scene Rendering
    Guo, Jingfeng
    Zhang, Xiaohan
    Zhao, Baozhu
    Liu, Qi
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VI, 2025, 15036 : 110 - 122