INCREMENTAL TENSOR DECOMPOSITION FOR FEW SHOT NEURAL RADIANCE FIELD

被引:0
|
作者
Li, Qian [1 ]
Wen, Cheng [2 ]
Fu, Rao [1 ]
机构
[1] Inria, Paris, France
[2] Univ Sydney, Camperdown, NSW, Australia
关键词
Novel View Synthesis; Tensor Decomposition; Few Shot Neural Radiance Field;
D O I
10.1109/ICASSP48485.2024.10445915
中图分类号
学科分类号
摘要
Neural Radiance Field (NeRF) stands out by demonstrating photo-realistic renderings, while it suffers from quality degradation when given only a few shot inputs. This paper aims to improve the rendering quality of NeRF from a few shot inputs. Original NeRF tends to overfit input views rapidly at the initial training stage when trained on sparse inputs. We address this challenge by presenting a novel incremental tensor decomposition method, where the resolution of decomposed tensors increases with the training iteration, enabling coarse to fine learning and alleviating the overfitting during the early stage. We offer several regularizations based on the proposed incremental learning process, including patch-based density regularization and depth regularization. Our proposed method outperforms previous baselines on the Realistic Synthetic 360 degrees dataset and achieves state-of-the-art results in PSNR.
引用
收藏
页码:3730 / 3734
页数:5
相关论文
共 50 条
  • [31] MarkNeRF: Watermarking for Neural Radiance Field
    Chen, Lifeng
    Liu, Jia
    Sun, Wenquan
    Dong, Weina
    Pan, Xiaozhong
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 80 (01): : 1235 - 1250
  • [32] Tensor gauge condition and tensor field decomposition
    Zhu, Ben-Chao
    Chen, Xiang-Song
    MODERN PHYSICS LETTERS A, 2015, 30 (35)
  • [33] Capsule neural tensor networks with multi-aspect information for Few-shot Knowledge Graph Completion
    Li, Qianyu
    Yao, Jiale
    Tang, Xiaoli
    Yu, Han
    Jiang, Siyu
    Yang, Haizhi
    Song, Hengjie
    NEURAL NETWORKS, 2023, 164 : 323 - 334
  • [34] pixelNeRF: Neural Radiance Fields from One or Few Images
    Yu, Alex
    Ye, Vickie
    Tancik, Matthew
    Kanazawa, Angjoo
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 4576 - 4585
  • [35] INCREMENTAL CP TENSOR DECOMPOSITION BY ALTERNATING MINIMIZATION METHOD
    Zeng, Chao
    Ng, Michael K.
    SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2021, 42 (02) : 832 - 858
  • [36] Few-Shot Incremental Learning for Label-to-Image Translation
    Chen, Pei
    Zhang, Yangkang
    Li, Zejian
    Sun, Lingyun
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 3687 - 3697
  • [37] Forward Compatible Few-Shot Class-Incremental Learning
    Zhou, Da-Wei
    Wang, Fu-Yun
    Ye, Han-Jia
    Ma, Liang
    Pu, Shiliang
    Zhan, De-Chuan
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 9036 - 9046
  • [38] Sylph: A Hypernetwork Framework for Incremental Few-shot Object Detection
    Yin, Li
    Perez-Rua, Juan M.
    Liang, Kevin J.
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 9025 - 9035
  • [39] Meta Module Generation for Fast Few-Shot Incremental Learning
    Xie, Shudong
    Li, Yiqun
    Lin, Dongyun
    Nwe, Tin Lay
    Dong, Sheng
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 1381 - 1390
  • [40] On the Approximation Risk of Few-Shot Class-Incremental Learning
    Wang, Xuan
    Ji, Zhong
    Liu, Xiyao
    Pang, Yanwei
    Han, Jungong
    COMPUTER VISION - ECCV 2024, PT LI, 2025, 15109 : 162 - 178