Stable Surface Regularization for Fast Few-Shot NeRF

被引:0
|
作者
Joung, Byeongin [1 ]
Lee, Byeong-Uk [2 ]
Choe, Jaesung [1 ]
Shin, Ukcheol [3 ]
Kang, Minjun [1 ]
Lee, Taeyeop [1 ]
Kweon, In So [1 ]
Yoon, Kuk-Jin [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Seoul, South Korea
[2] KRAFTON, Seoul, South Korea
[3] KRAFTON, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
NEURAL RADIANCE FIELDS; SCENES;
D O I
10.1109/3DV62453.2024.00147
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes an algorithm for synthesizing novel views under few-shot setup. The main concept is to develop a stable surface regularization technique called Annealing Signed Distance Function (ASDF), which anneals the surface in a coarse-to-fine manner to accelerate convergence speed. We observe that the Eikonal loss - which is a widely known geometric regularization - requires dense training signal to shape different level-sets of SDF, leading to low-fidelity results under few-shot training. In contrast, the proposed surface regularization successfully reconstructs scenes and produce high-fidelity geometry with stable training. Our method is further accelerated by utilizing grid representation and monocular geometric priors. Finally, the proposed approach is up to 45 times faster than existing few-shot novel view synthesis methods, and it produces comparable results in the ScanNet dataset and NeRF-Real dataset.
引用
收藏
页码:1478 / 1487
页数:10
相关论文
共 50 条
  • [41] Variational Few-Shot Learning
    Zhang, Jian
    Zhao, Chenglong
    Ni, Bingbing
    Xu, Minghao
    Yang, Xiaokang
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 1685 - 1694
  • [42] Few-Shot NeRF-Based View Synthesis for Viewpoint-Biased Camera Pose Estimation
    Ito, Sota
    Aizawa, Hiroaki
    Kato, Kunihito
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT II, 2023, 14255 : 308 - 319
  • [43] Fractal Few-Shot Learning
    Zhou, Fobao
    Huang, Wenkai
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 35 (11) : 1 - 15
  • [44] Few-shot Classifier GAN
    Ali-Gombe, Adamu
    Elyan, Eyad
    Savoye, Yann
    Jayne, Chrisina
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [45] Fast and Few-Shot Unsupervised Defect Detection on Flexible Packaging Surfaces
    Li, Xin
    Li, Shan
    IEEE JOURNAL OF RADIO FREQUENCY IDENTIFICATION, 2022, 6 : 842 - 845
  • [46] Inverse is Better! Fast and Accurate Prompt for Few-shot Slot Tagging
    Hou, Yutai
    Chen, Cheng
    Luo, Xianzhen
    Li, Bohan
    Che, Wanxiang
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), 2022, : 637 - 647
  • [47] 3FabRec: Fast Few-shot Face alignment by Reconstruction
    Browatzki, Bjorn
    Wallraven, Christian
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 6109 - 6119
  • [48] A review of few-shot classification
    Lim, Jia Min
    Lim, Kian Ming
    Lee, Chin Poo
    Lim, Jit Yan
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 275
  • [49] Interventional Few-Shot Learning
    Yue, Zhongqi
    Zhang, Hanwang
    Sun, Qianru
    Hua, Xian-Sheng
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [50] EICO: Improving Few-Shot Text Classification via Explicit and Implicit Consistency Regularization
    Zhao, Lei
    Yao, Cheng
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL 2022), 2022, : 3582 - 3587