Progress in Novel View Synthesis Using Neural Radiance Fields

被引:1
|
作者
He Gaoxiang [1 ,2 ]
Zhu Bin [1 ,2 ]
Xie Bo [1 ,2 ]
Chen Yi [1 ,2 ]
机构
[1] Natl Univ Def Technol, Coll Elect Engn, State Key Lab Pulsed Power Laser Technol, Hefei 230037, Anhui, Peoples R China
[2] Infrared & Low Temp Plasma Key Lab Anhui Prov, Hefei 230037, Anhui, Peoples R China
关键词
neural radiance field; novel view synthesis; three-dimensional reconstruction; differentiable rendering;
D O I
10.3788/LOP231578
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
One highly focused research direction in neural rendering is the neural radiance field (NeRF), which offers a novel implicit representation of three-dimensional scenes. NeRF conceptualizes the scene as a medium comprising numerous luminescent particles and applies a differentiable volume rendering equation to aid virtual cameras in rendering corresponding scene images. Its implicit and differentiable characteristics confer remarkable advantages on NeRF, particularly in the field of new viewpoint synthesis. This review thoroughly examines the latest research progress of NeRF in the domain of new viewpoint synthesis. Moreover, this study comprehensively analyzes how NeRF addresses unbounded scenes, dynamic environmental scenes, and sparse viewpoint scenes in practical applications, along with its advancements in training and inference acceleration. Concurrently, this study highlights NeRF's challenges in this task and presents a vision for future research.
引用
收藏
页数:13
相关论文
共 74 条
  • [1] Barron JT, 2023, Arxiv, DOI arXiv:2304.06706
  • [2] Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields
    Barron, Jonathan T.
    Mildenhall, Ben
    Verbin, Dor
    Srinivasan, Pratul P.
    Hedman, Peter
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5460 - 5469
  • [3] Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields
    Barron, Jonathan T.
    Mildenhall, Ben
    Tancik, Matthew
    Hedman, Peter
    Martin-Brualla, Ricardo
    Srinivasan, Pratul P.
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5835 - 5844
  • [4] Bojanowski P, 2019, Arxiv, DOI arXiv:1707.05776
  • [5] [常远 Chang Yuan], 2021, [图学学报, Journal of Graphics], V42, P376
  • [6] TensoRF: Tensorial Radiance Fields
    Chen, Anpei
    Xu, Zexiang
    Geiger, Andreas
    Yu, Jingyi
    Su, Hao
    [J]. COMPUTER VISION - ECCV 2022, PT XXXII, 2022, 13692 : 333 - 350
  • [7] MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo
    Chen, Anpei
    Xu, Zexiang
    Zhao, Fuqiang
    Zhang, Xiaoshuai
    Xiang, Fanbo
    Yu, Jingyi
    Su, Hao
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14104 - 14113
  • [8] Hallucinated Neural Radiance Fields in the Wild
    Chen, Xingyu
    Zhang, Qi
    Li, Xiaoyu
    Chen, Yue
    Feng, Ying
    Wang, Xuan
    Wang, Jue
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 12933 - 12942
  • [9] Dellaert F, 2021, Arxiv, DOI arXiv:2101.05204
  • [10] Deng B, 2023, JaxNeRF: an efficient jax implementation of NeRF