Robust Dynamic Radiance Fields

被引:34
|
作者
Liu, Yu-Lun [2 ]
Gao, Chen [1 ]
Meuleman, Andreas [3 ]
Tseng, Hung-Yu [1 ]
Saraf, Ayush [1 ]
Kim, Changil [1 ]
Chuang, Yung-Yu [2 ]
Kopf, Johannes [1 ]
Huang, Jia-Bin [1 ,4 ]
机构
[1] Meta, Menlo Pk, CA 94025 USA
[2] Natl Taiwan Univ, Taipei, Taiwan
[3] Korea Adv Inst Sci & Technol, Daejeon, South Korea
[4] Univ Maryland, College Pk, MD USA
关键词
VIDEO;
D O I
10.1109/CVPR52729.2023.00010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Dynamic radiance field reconstruction methods aim to model the time-varying structure and appearance of a dynamic scene. Existing methods, however, assume that accurate camera poses can be reliably estimated by Structure from Motion (SfM) algorithms. These methods, thus, are unreliable as SfM algorithms often fail or produce erroneous poses on challenging videos with highly dynamic objects, poorly textured surfaces, and rotating camera motion. We address this robustness issue by jointly estimating the static and dynamic radiance fields along with the camera parameters (poses and focal length). We demonstrate the robustness of our approach via extensive quantitative and qualitative experiments. Our results show favorable performance over the state-of-the-art dynamic view synthesis methods.
引用
收藏
页码:13 / 23
页数:11
相关论文
共 50 条
  • [31] Interactive Segmentation of Radiance Fields
    Goel, Rahul
    Sirikonda, Dhawal
    Saini, Saurabh
    Narayanan, P. J.
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 4201 - 4211
  • [32] Colorizing Monochromatic Radiance Fields
    Cheng, Yean
    Wan, Renjie
    Weng, Shuchen
    Zhu, Chengxuan
    Chang, Yakun
    Shi, Boxin
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 2, 2024, : 1317 - 1325
  • [33] SlimmeRF: Slimmable Radiance Fields
    Yuan, Shiran
    Zhao, Hao
    2024 INTERNATIONAL CONFERENCE IN 3D VISION, 3DV 2024, 2024, : 64 - 74
  • [34] DeRF: Decomposed Radiance Fields
    Rebain, Daniel
    Jiang, Wei
    Yazdani, Soroosh
    Li, Ke
    Yi, Kwang Moo
    Tagliasacchi, Andrea
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 14148 - 14156
  • [35] Editing Conditional Radiance Fields
    Liu, Steven
    Zhang, Xiuming
    Zhang, Zhoutong
    Zhang, Richard
    Zhu, Jun-Yan
    Russell, Bryan
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5753 - 5763
  • [36] Neural Transmitted Radiance Fields
    Zhu, Chengxuan
    Wan, Renjie
    Shi, Boxin
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [37] Reconstructionless Airborne Radiance Fields
    Praschl, Christoph
    Boess, Leopold
    Schedl, David C.
    PROCEEDINGS OF THE SIGGRAPH 2024 POSTERS, 2024,
  • [38] Deforming Radiance Fields with Cages
    Xu, Tianhan
    Harada, Tatsuya
    COMPUTER VISION - ECCV 2022, PT XXXIII, 2022, 13693 : 159 - 175
  • [39] ARF: Artistic Radiance Fields
    Zhang, Kai
    Kolkin, Nick
    Bi, Sai
    Luan, Fujun
    Xu, Zexiang
    Shechtman, Eli
    Snavely, Noah
    COMPUTER VISION, ECCV 2022, PT XXXI, 2022, 13691 : 717 - 733
  • [40] ThermalNeRF: Thermal Radiance Fields
    Lin, Yvette Y.
    Pan, Xin-Yi
    Fridovich-Keil, Sara
    Wetzstein, Gordon
    2024 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY, ICCP 2024, 2024,