HDR-NeRF: High Dynamic Range Neural Radiance Fields

被引:56
|
作者
Huang, Xin [1 ,2 ]
Zhang, Qi [2 ]
Feng, Ying [2 ]
Li, Hongdong [3 ]
Wang, Xuan [2 ]
Wang, Qing [1 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
[2] Tencent AI Lab, Shenzhen, Peoples R China
[3] Australian Natl Univ, Canberra, ACT, Australia
关键词
D O I
10.1109/CVPR52688.2022.01785
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present High Dynamic Range Neural Radiance Fields (HDR-NeRF) to recover an HDR radiance field from a set of low dynamic range (LDR) views with different exposures. Using the HDR-NeRF, we are able to generate both novel HDR views and novel LDR views under different exposures. The key to our method is to model the simplified physical imaging process, which dictates that the radiance of a scene point transforms to a pixel value in the LDR image with two implicit functions: a radiance field and a tone mapper. The radiance field encodes the scene radiance (values vary from 0 to +infinity), which outputs the density and radiance of a ray by giving corresponding ray origin and ray direction. The tone mapper models the mapping process that a ray hitting on the camera sensor becomes a pixel value. The color of the ray is predicted by feeding the radiance and the corresponding exposure time into the tone mapper. We use the classic volume rendering technique to project the output radiance, colors and densities into HDR and LDR images, while only the input LDR images are used as the supervision. We collect a new forward-facing HDR dataset to evaluate the proposed method. Experimental results on synthetic and real-world scenes validate that our method can not only accurately control the exposures of synthesized views but also render views with a high dynamic range.
引用
收藏
页码:18377 / 18387
页数:11
相关论文
共 50 条
  • [1] D-NeRF: Neural Radiance Fields for Dynamic Scenes
    Pumarola, Albert
    Corona, Enric
    Pons-Moll, Gerard
    Moreno-Noguer, Francesc
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 10313 - 10322
  • [2] NeRF-DS: Neural Radiance Fields for Dynamic Specular Objects
    Yan, Zhiwen
    Li, Chen
    Lee, Gim Hee
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 8285 - 8295
  • [3] HDR-Plenoxels: Self-Calibrating High Dynamic Range Radiance Fields
    Jun-Seong, Kim
    Yu-Ji, Kim
    Ye-Bin, Moon
    Oh, Tae-Hyun
    COMPUTER VISION - ECCV 2022, PT XXXII, 2022, 13692 : 384 - 401
  • [4] Ced-NeRF: A Compact and Efficient Method for Dynamic Neural Radiance Fields
    Lin, Youtian
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 4, 2024, : 3504 - 3512
  • [5] nerf2nerf: Pairwise Registration of Neural Radiance Fields
    Goli, Lily
    Rebain, Daniel
    Sabour, Sara
    Garg, Animesh
    Tagliasacchi, Andrea
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023), 2023, : 9354 - 9361
  • [6] NeRF-SR: High Quality Neural Radiance Fields using Supersampling
    Wang, Chen
    Wu, Xian
    Guo, Yuan-Chen
    Zhang, Song-Hai
    Tai, Yu-Wing
    Hu, Shi-Min
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 6445 - 6454
  • [7] Fast High Dynamic Range Radiance Fields for Dynamic Scenes
    Wu, Guanjun
    Yi, Taoran
    Fang, Jiemin
    Liu, Wenyu
    Wang, Xinggang
    2024 INTERNATIONAL CONFERENCE IN 3D VISION, 3DV 2024, 2024, : 862 - 872
  • [8] Strata-NeRF : Neural Radiance Fields for Stratified Scenes
    Dhiman, Ankit
    Srinath, R.
    Rangwani, Harsh
    Parihar, Rishubh
    Boregowda, Lokesh R.
    Sridhar, Srinath
    Babu, R. Venkatesh
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 17557 - 17568
  • [9] DReg-NeRF: Deep Registration for Neural Radiance Fields
    Chen, Yu
    Lee, Gim Hee
    arXiv, 2023,
  • [10] NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
    Mildenhall, Ben
    Srinivasan, Pratul P.
    Tancik, Matthew
    Barron, Jonathan T.
    Ramamoorthi, Ravi
    Ng, Ren
    COMMUNICATIONS OF THE ACM, 2022, 65 (01) : 99 - 106