INCREMENTAL TENSOR DECOMPOSITION FOR FEW SHOT NEURAL RADIANCE FIELD

被引:0
|
作者
Li, Qian [1 ]
Wen, Cheng [2 ]
Fu, Rao [1 ]
机构
[1] Inria, Paris, France
[2] Univ Sydney, Camperdown, NSW, Australia
关键词
Novel View Synthesis; Tensor Decomposition; Few Shot Neural Radiance Field;
D O I
10.1109/ICASSP48485.2024.10445915
中图分类号
学科分类号
摘要
Neural Radiance Field (NeRF) stands out by demonstrating photo-realistic renderings, while it suffers from quality degradation when given only a few shot inputs. This paper aims to improve the rendering quality of NeRF from a few shot inputs. Original NeRF tends to overfit input views rapidly at the initial training stage when trained on sparse inputs. We address this challenge by presenting a novel incremental tensor decomposition method, where the resolution of decomposed tensors increases with the training iteration, enabling coarse to fine learning and alleviating the overfitting during the early stage. We offer several regularizations based on the proposed incremental learning process, including patch-based density regularization and depth regularization. Our proposed method outperforms previous baselines on the Realistic Synthetic 360 degrees dataset and achieves state-of-the-art results in PSNR.
引用
收藏
页码:3730 / 3734
页数:5
相关论文
共 50 条
  • [21] A survey on few-shot class-incremental learning
    Tian, Songsong
    Li, Lusi
    Li, Weijun
    Ran, Hang
    Ning, Xin
    Tiwari, Prayag
    NEURAL NETWORKS, 2024, 169 : 307 - 324
  • [22] Incremental Few-Shot Learning for Pedestrian Attribute Recognition
    Xiang, Liuyu
    Jin, Xiaoming
    Ding, Guiguang
    Han, Jungong
    Li, Leida
    PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2019, : 3912 - 3918
  • [23] Coarse-To-Fine Incremental Few-Shot Learning
    Xiang, Xiang
    Tan, Yuwen
    Wan, Qian
    Ma, Jing
    Yuille, Alan
    Hager, Gregory D.
    COMPUTER VISION, ECCV 2022, PT XXXI, 2022, 13691 : 205 - 222
  • [24] Incremental few-shot learning via implanting and consolidating
    Li, Yiting
    Zhu, Haiyue
    Ma, Jun
    Xiang, Cheng
    Vadakkepat, Prahlad
    NEUROCOMPUTING, 2023, 559
  • [25] Incremental Few-Shot Learning with Attention Attractor Networks
    Ren, Mengye
    Liao, Renjie
    Fetaya, Ethan
    Zemel, Richard S.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [26] Graph Few-shot Class-incremental Learning
    Tan, Zhen
    Ding, Kaize
    Guo, Ruocheng
    Liu, Huan
    WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING, 2022, : 987 - 996
  • [27] Constrained Few-shot Class-incremental Learning
    Hersche, Michael
    Karunaratne, Geethan
    Cherubini, Giovanni
    Benini, Luca
    Sebastian, Abu
    Rahimi, Abbas
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 9047 - 9057
  • [28] Few-Shot Incremental Learning with Continually Evolved Classifiers
    Zhang, Chi
    Song, Nan
    Lin, Guosheng
    Zheng, Yun
    Pan, Pan
    Xu, Yinghui
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12450 - 12459
  • [29] Efficient Few-Shot Incremental Training for Landmark Recognition
    Neuschmied, Helmut
    Bailer, Werner
    PROCEEDINGS OF THE 2024 ACM INTERNATIONAL CONFERENCE ON INTERACTIVE MEDIA EXPERIENCES WORKSHOPS, IMXW 2024, 2024, : 44 - 51
  • [30] Few-shot Neural Architecture Search
    Zhao, Yiyang
    Wang, Linnan
    Tian, Yuandong
    Fonseca, Rodrigo
    Guo, Tian
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139