Robust Dynamic Radiance Fields

被引:34
|
作者
Liu, Yu-Lun [2 ]
Gao, Chen [1 ]
Meuleman, Andreas [3 ]
Tseng, Hung-Yu [1 ]
Saraf, Ayush [1 ]
Kim, Changil [1 ]
Chuang, Yung-Yu [2 ]
Kopf, Johannes [1 ]
Huang, Jia-Bin [1 ,4 ]
机构
[1] Meta, Menlo Pk, CA 94025 USA
[2] Natl Taiwan Univ, Taipei, Taiwan
[3] Korea Adv Inst Sci & Technol, Daejeon, South Korea
[4] Univ Maryland, College Pk, MD USA
关键词
VIDEO;
D O I
10.1109/CVPR52729.2023.00010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Dynamic radiance field reconstruction methods aim to model the time-varying structure and appearance of a dynamic scene. Existing methods, however, assume that accurate camera poses can be reliably estimated by Structure from Motion (SfM) algorithms. These methods, thus, are unreliable as SfM algorithms often fail or produce erroneous poses on challenging videos with highly dynamic objects, poorly textured surfaces, and rotating camera motion. We address this robustness issue by jointly estimating the static and dynamic radiance fields along with the camera parameters (poses and focal length). We demonstrate the robustness of our approach via extensive quantitative and qualitative experiments. Our results show favorable performance over the state-of-the-art dynamic view synthesis methods.
引用
收藏
页码:13 / 23
页数:11
相关论文
共 50 条
  • [21] NeRF-DS: Neural Radiance Fields for Dynamic Specular Objects
    Yan, Zhiwen
    Li, Chen
    Lee, Gim Hee
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 8285 - 8295
  • [22] Flow Supervised Neural Radiance Fields for Static-Dynamic Decomposition
    Chen, Quei-An
    Tsukada, Akihiro
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2022, 2022, : 10641 - 10647
  • [23] NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fields
    Song, Liangchen
    Chen, Anpei
    Li, Zhong
    Chen, Zhang
    Chen, Lele
    Yuan, Junsong
    Xu, Yi
    Geiger, Andreas
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2023, 29 (05) : 2732 - 2742
  • [24] Fast Dynamic Radiance Fields with Time-Aware Neural Voxels
    Fang, Jiemin
    Yi, Taoran
    Wang, Xinggang
    Xie, Lingxi
    Zhang, Xiaopeng
    Liu, Wenyu
    Niessner, Matthias
    Tian, Qi
    PROCEEDINGS SIGGRAPH ASIA 2022, 2022,
  • [25] Temporal Interpolation Is All You Need for Dynamic Neural Radiance Fields
    Park, Sungheon
    Son, Minjung
    Tang, Seokhwan
    Ahn, Young Chun
    Kim, Ji-Yeon
    Kang, Nahyup
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 4212 - 4221
  • [26] Urban Radiance Fields
    Rematas, Konstantinos
    Liu, Andrew
    Srinivasan, Pratul
    Barron, Jonathan
    Tagliasacchi, Andrea
    Funkhouser, Thomas
    Ferrari, Vittorio
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 12922 - 12932
  • [27] RWNeRF: Robust Watermarking Scheme for Neural Radiance Fields Based on Invertible Neural Networks
    Sun, Wenquan
    Liu, Jia
    Dong, Weina
    Chen, Lifeng
    Di, Fuqiang
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 80 (03): : 4065 - 4083
  • [28] Dyn-E: Local appearance editing of dynamic neural radiance fields
    Shentu, Yinji
    Zhang, Shangzhan
    Xu, Mingyue
    Shuai, Qing
    Chen, Tianrun
    Peng, Sida
    Zhou, Xiaowei
    COMPUTERS & GRAPHICS-UK, 2025, 126
  • [29] ToRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesis
    Attal, Benjamin
    Laidlaw, Eliot
    Gokaslan, Aaron
    Kim, Changil
    Richardt, Christian
    Tompkin, James
    O'Toole, Matthew
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021,
  • [30] Ced-NeRF: A Compact and Efficient Method for Dynamic Neural Radiance Fields
    Lin, Youtian
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 4, 2024, : 3504 - 3512