HDR-NeRF: High Dynamic Range Neural Radiance Fields

被引:56
|
作者
Huang, Xin [1 ,2 ]
Zhang, Qi [2 ]
Feng, Ying [2 ]
Li, Hongdong [3 ]
Wang, Xuan [2 ]
Wang, Qing [1 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
[2] Tencent AI Lab, Shenzhen, Peoples R China
[3] Australian Natl Univ, Canberra, ACT, Australia
关键词
D O I
10.1109/CVPR52688.2022.01785
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present High Dynamic Range Neural Radiance Fields (HDR-NeRF) to recover an HDR radiance field from a set of low dynamic range (LDR) views with different exposures. Using the HDR-NeRF, we are able to generate both novel HDR views and novel LDR views under different exposures. The key to our method is to model the simplified physical imaging process, which dictates that the radiance of a scene point transforms to a pixel value in the LDR image with two implicit functions: a radiance field and a tone mapper. The radiance field encodes the scene radiance (values vary from 0 to +infinity), which outputs the density and radiance of a ray by giving corresponding ray origin and ray direction. The tone mapper models the mapping process that a ray hitting on the camera sensor becomes a pixel value. The color of the ray is predicted by feeding the radiance and the corresponding exposure time into the tone mapper. We use the classic volume rendering technique to project the output radiance, colors and densities into HDR and LDR images, while only the input LDR images are used as the supervision. We collect a new forward-facing HDR dataset to evaluate the proposed method. Experimental results on synthetic and real-world scenes validate that our method can not only accurately control the exposures of synthesized views but also render views with a high dynamic range.
引用
收藏
页码:18377 / 18387
页数:11
相关论文
共 50 条
  • [11] NeRF-Editing: Geometry Editing of Neural Radiance Fields
    Yuan, Yu-Jie
    Sun, Yang-Tian
    Lai, Yu-Kun
    Ma, Yuewen
    Jia, Rongfei
    Gao, Lin
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 18332 - 18343
  • [12] SeaThru-NeRF: Neural Radiance Fields in Scattering Media
    Levy, Deborah
    Peleg, Amit
    Pearl, Naama
    Rosenbaum, Dan
    Akkaynak, Derya
    Korman, Simon
    Treibitz, Tali
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 56 - 65
  • [13] NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections
    Martin-Brualla, Ricardo
    Radwan, Noha
    Sajjadi, Mehdi S. M.
    Barron, Jonathan T.
    Dosovitskiy, Alexey
    Duckworth, Daniel
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 7206 - 7215
  • [14] DReg-NeRF: Deep Registration for Neural Radiance Fields
    Chen, Yu
    Lee, Gim Hee
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 22646 - 22656
  • [15] DReg-NeRF: Deep Registration for Neural Radiance Fields
    Chen, Yu
    Lee, Gim Hee
    Proceedings of the IEEE International Conference on Computer Vision, 2023, : 22646 - 22656
  • [16] Ultra-NeRF: Neural Radiance Fields for Ultrasound Imaging
    Wysocki, Magdalena
    Azampour, Mohammad Farid
    Eilers, Christine
    Busam, Benjamin
    Salehil, Mehrdad
    Navab, Nassir
    MEDICAL IMAGING WITH DEEP LEARNING, VOL 227, 2023, 227 : 382 - 401
  • [17] NeRF-Texture: Texture Synthesis with Neural Radiance Fields
    Huang, Yi-Hua
    Cao, Yan-Pei
    Lai, Yu-Kun
    Shan, Ying
    Gao, Lin
    PROCEEDINGS OF SIGGRAPH 2023 CONFERENCE PAPERS, SIGGRAPH 2023, 2023,
  • [18] Deblur-NeRF: Neural Radiance Fields from Blurry Images
    Ma, Li
    Li, Xiaoyu
    Liao, Jing
    Zhang, Qi
    Wang, Xuan
    Wang, Jue
    Sander, Pedro, V
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 12851 - 12860
  • [19] NeRF-MS: Neural Radiance Fields with Multi-Sequence
    Li, Peihao
    Wang, Shaohui
    Yang, Chen
    Liu, Bingbing
    Qiu, Weichao
    Wang, Haoqian
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 18545 - 18554
  • [20] NeRF-QA: Neural Radiance Fields Quality Assessment Database
    Martin, Pedro
    Rodrigues, Antonio
    Ascenso, Joao
    Queluz, Maria Paula
    2023 15TH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE, QOMEX, 2023, : 107 - 110