Stable Surface Regularization for Fast Few-Shot NeRF

被引:0
|
作者
Joung, Byeongin [1 ]
Lee, Byeong-Uk [2 ]
Choe, Jaesung [1 ]
Shin, Ukcheol [3 ]
Kang, Minjun [1 ]
Lee, Taeyeop [1 ]
Kweon, In So [1 ]
Yoon, Kuk-Jin [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Seoul, South Korea
[2] KRAFTON, Seoul, South Korea
[3] KRAFTON, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
NEURAL RADIANCE FIELDS; SCENES;
D O I
10.1109/3DV62453.2024.00147
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes an algorithm for synthesizing novel views under few-shot setup. The main concept is to develop a stable surface regularization technique called Annealing Signed Distance Function (ASDF), which anneals the surface in a coarse-to-fine manner to accelerate convergence speed. We observe that the Eikonal loss - which is a widely known geometric regularization - requires dense training signal to shape different level-sets of SDF, leading to low-fidelity results under few-shot training. In contrast, the proposed surface regularization successfully reconstructs scenes and produce high-fidelity geometry with stable training. Our method is further accelerated by utilizing grid representation and monocular geometric priors. Finally, the proposed approach is up to 45 times faster than existing few-shot novel view synthesis methods, and it produces comparable results in the ScanNet dataset and NeRF-Real dataset.
引用
收藏
页码:1478 / 1487
页数:10
相关论文
共 50 条
  • [1] Few-Shot NeRF by Adaptive Rendering Loss Regularization
    Xu, Qingshan
    Yi, Xuanyu
    Xu, Jianyao
    Tao, Wenbing
    Ong, Yew-Soon
    Zhang, Hanwang
    COMPUTER VISION - ECCV 2024, PT LXVI, 2025, 15124 : 125 - 142
  • [2] A Novel Entropy-Based Regularization for NeRF to View Synthesis in Few-Shot Scenarios
    Liu, Ting
    Zhang, Sijia
    Li, Zhuoyuan
    Sun, Yi
    ADVANCES IN NEURAL NETWORKS-ISNN 2024, 2024, 14827 : 113 - 122
  • [3] GeoAug: Data Augmentation for Few-Shot NeRF with Geometry Constraints
    Chen, Di
    Liu, Yu
    Huang, Lianghua
    Wang, Bin
    Pan, Pan
    COMPUTER VISION - ECCV 2022, PT XVII, 2022, 13677 : 322 - 337
  • [4] Regularization with Multiple Feature Combination for Few-Shot Learning
    Lee, Su Been
    Park, Jun Ho
    Kim, Ji Young
    Lee, Seung Yeol
    Heo, Jae-Pil
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP 2021), 2021, : 334 - 337
  • [5] Smoothness Similarity Regularization for Few-Shot GAN Adaptation
    Sushko, Vadim
    Wang, Ruyu
    Gall, Juergen
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 7050 - 7059
  • [6] Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis
    Jain, Ajay
    Tancik, Matthew
    Abbeel, Pieter
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5865 - 5874
  • [7] Few-Shot Remote Sensing Novel View Synthesis with Geometry Constraint NeRF
    Kang, Jiaming
    Chen, Keyan
    Zou, Zhengxia
    Shi, Zhenwei
    GUIDANCE NAVIGATION AND CONTROL, 2024, 04 (03)
  • [8] Few-Shot Remote Sensing Novel View Synthesis with Geometry Constraint NeRF
    Jiaming Kang
    Keyan Chen
    Zhengxia Zou
    Zhenwei Shi
    Guidance,Navigation and Control, 2024, (03) : 70 - 91
  • [9] Boosting Few-Shot Learning via Attentive Feature Regularization
    Zhu, Xingyu
    Wang, Shuo
    Lu, Jinda
    Hao, Yanbin
    Liu, Haifeng
    He, Xiangnan
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 7, 2024, : 7793 - 7801
  • [10] Classification and Fast Few-Shot Learning of Steel Surface Defects with Randomized Network
    Nagy, Amr M.
    Czuni, Laszlo
    APPLIED SCIENCES-BASEL, 2022, 12 (08):