Progress in Novel View Synthesis Using Neural Radiance Fields

被引:1
|
作者
He Gaoxiang [1 ,2 ]
Zhu Bin [1 ,2 ]
Xie Bo [1 ,2 ]
Chen Yi [1 ,2 ]
机构
[1] Natl Univ Def Technol, Coll Elect Engn, State Key Lab Pulsed Power Laser Technol, Hefei 230037, Anhui, Peoples R China
[2] Infrared & Low Temp Plasma Key Lab Anhui Prov, Hefei 230037, Anhui, Peoples R China
关键词
neural radiance field; novel view synthesis; three-dimensional reconstruction; differentiable rendering;
D O I
10.3788/LOP231578
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
One highly focused research direction in neural rendering is the neural radiance field (NeRF), which offers a novel implicit representation of three-dimensional scenes. NeRF conceptualizes the scene as a medium comprising numerous luminescent particles and applies a differentiable volume rendering equation to aid virtual cameras in rendering corresponding scene images. Its implicit and differentiable characteristics confer remarkable advantages on NeRF, particularly in the field of new viewpoint synthesis. This review thoroughly examines the latest research progress of NeRF in the domain of new viewpoint synthesis. Moreover, this study comprehensively analyzes how NeRF addresses unbounded scenes, dynamic environmental scenes, and sparse viewpoint scenes in practical applications, along with its advancements in training and inference acceleration. Concurrently, this study highlights NeRF's challenges in this task and presents a vision for future research.
引用
收藏
页数:13
相关论文
共 74 条
  • [41] Rahaman N, 2019, Arxiv, DOI arXiv:1806.08734
  • [42] MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenes
    Reiser, Christian
    Szeliski, Richard
    Verbin, Dor
    Srinivasan, Pratul P.
    Mildenhall, Ben
    Geiger, Andreas
    Barron, Jonathan T.
    Hedman, Peter
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2023, 42 (04):
  • [43] Structure-from-Motion Revisited
    Schonberger, Johannes L.
    Frahm, Jan -Michael
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 4104 - 4113
  • [44] Simonyan K, 2015, Arxiv, DOI arXiv:1409.1556
  • [45] Song J, 2023, Arxiv, DOI arXiv:2305.19201
  • [46] Song LC, 2023, Arxiv, DOI [arXiv:2303.08370, 10.48550/arXiv.2303.08370]
  • [47] Sun C, 2022, Arxiv, DOI arXiv:2206.05085
  • [48] Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction
    Sun, Cheng
    Sun, Min
    Chen, Hwann-Tzong
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5449 - 5459
  • [49] Multi-view to Novel View: Synthesizing Novel Views With Self-learned Confidence
    Sun, Shao-Hua
    Huh, Minyoung
    Liao, Yuan-Hong
    Zhang, Ning
    Lim, Joseph J.
    [J]. COMPUTER VISION - ECCV 2018, PT III, 2018, 11207 : 162 - 178
  • [50] Block-NeRF: Scalable Large Scene Neural View Synthesis
    Tancik, Matthew
    Casser, Vincent
    Yan, Xinchen
    Pradhan, Sabeek
    Mildenhall, Ben P.
    Srinivasan, Pratul
    Barron, Jonathan T.
    Kretzschmar, Henrik
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 8238 - 8248