Stable Surface Regularization for Fast Few-Shot NeRF

被引:0
|
作者
Joung, Byeongin [1 ]
Lee, Byeong-Uk [2 ]
Choe, Jaesung [1 ]
Shin, Ukcheol [3 ]
Kang, Minjun [1 ]
Lee, Taeyeop [1 ]
Kweon, In So [1 ]
Yoon, Kuk-Jin [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Seoul, South Korea
[2] KRAFTON, Seoul, South Korea
[3] KRAFTON, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
NEURAL RADIANCE FIELDS; SCENES;
D O I
10.1109/3DV62453.2024.00147
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes an algorithm for synthesizing novel views under few-shot setup. The main concept is to develop a stable surface regularization technique called Annealing Signed Distance Function (ASDF), which anneals the surface in a coarse-to-fine manner to accelerate convergence speed. We observe that the Eikonal loss - which is a widely known geometric regularization - requires dense training signal to shape different level-sets of SDF, leading to low-fidelity results under few-shot training. In contrast, the proposed surface regularization successfully reconstructs scenes and produce high-fidelity geometry with stable training. Our method is further accelerated by utilizing grid representation and monocular geometric priors. Finally, the proposed approach is up to 45 times faster than existing few-shot novel view synthesis methods, and it produces comparable results in the ScanNet dataset and NeRF-Real dataset.
引用
收藏
页码:1478 / 1487
页数:10
相关论文
共 50 条
  • [31] FewarNet: An Efficient Few-Shot View Synthesis Network Based on Trend Regularization
    Song, Chenxi
    Wang, Shigang
    Wei, Jian
    Zhao, Yan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (10) : 9264 - 9280
  • [32] FewShotTextGCN: K-hop neighborhood regularization for few-shot learning on graphs
    van der Heijden, Niels
    Shutova, Ekaterina
    Yannakoudakis, Helen
    17TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, EACL 2023, 2023, : 1187 - 1200
  • [33] Few-shot prototype alignment regularization network for document image layout segementation
    Li, Yujie
    Zhang, Pengfei
    Xu, Xing
    Lai, Yi
    Shen, Fumin
    Chen, Lijiang
    Gao, Pengxiang
    PATTERN RECOGNITION, 2021, 115
  • [34] ProtoMed: Prototypical networks with auxiliary regularization for few-shot medical image classification
    Ouahab, Achraf
    Ben Ahmed, Olfa
    IMAGE AND VISION COMPUTING, 2025, 154
  • [35] HARDMIX: A REGULARIZATION METHOD TO MITIGATE THE LARGE SHIFT IN FEW-SHOT DOMAIN ADAPTATION
    Liang, Ziyun
    Gu, Yun
    Yang, Jie
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 454 - 458
  • [36] DOMAIN GENERALIZED FEW-SHOT IMAGE CLASSIFICATION VIA META REGULARIZATION NETWORK
    Zhang, Min
    Huang, Siteng
    Wang, Donglin
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 3748 - 3752
  • [37] Federated Few-shot Learning
    Wang, Song
    Fu, Xingbo
    Ding, Kaize
    Chen, Chen
    Chen, Huiyuan
    Li, Jundong
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 2374 - 2385
  • [38] Defensive Few-Shot Learning
    Li, Wenbin
    Wang, Lei
    Zhang, Xingxing
    Qi, Lei
    Huo, Jing
    Gao, Yang
    Luo, Jiebo
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) : 5649 - 5667
  • [39] Few-shot logo detection
    Hou, Sujuan
    Liu, Wenjie
    Karim, Awudu
    Jia, Zhixiang
    Jia, Weikuan
    Zheng, Yuanjie
    IET COMPUTER VISION, 2023, 17 (05) : 586 - 598
  • [40] Survey on Few-shot Learning
    Zhao K.-L.
    Jin X.-L.
    Wang Y.-Z.
    Ruan Jian Xue Bao/Journal of Software, 2021, 32 (02): : 349 - 369