INCREMENTAL TENSOR DECOMPOSITION FOR FEW SHOT NEURAL RADIANCE FIELD

被引:0
|
作者
Li, Qian [1 ]
Wen, Cheng [2 ]
Fu, Rao [1 ]
机构
[1] Inria, Paris, France
[2] Univ Sydney, Camperdown, NSW, Australia
关键词
Novel View Synthesis; Tensor Decomposition; Few Shot Neural Radiance Field;
D O I
10.1109/ICASSP48485.2024.10445915
中图分类号
学科分类号
摘要
Neural Radiance Field (NeRF) stands out by demonstrating photo-realistic renderings, while it suffers from quality degradation when given only a few shot inputs. This paper aims to improve the rendering quality of NeRF from a few shot inputs. Original NeRF tends to overfit input views rapidly at the initial training stage when trained on sparse inputs. We address this challenge by presenting a novel incremental tensor decomposition method, where the resolution of decomposed tensors increases with the training iteration, enabling coarse to fine learning and alleviating the overfitting during the early stage. We offer several regularizations based on the proposed incremental learning process, including patch-based density regularization and depth regularization. Our proposed method outperforms previous baselines on the Realistic Synthetic 360 degrees dataset and achieves state-of-the-art results in PSNR.
引用
收藏
页码:3730 / 3734
页数:5
相关论文
共 50 条
  • [1] Exploiting Depth Priors for Few-Shot Neural Radiance Field Reconstruction
    Chen, Shuya
    Li, Zheyang
    Zhu, Hao
    Tan, Wenming
    Ren, Ye
    Xiang, Zhiyu
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (11): : 9844 - 9851
  • [2] Is Vanilla MLP in Neural Radiance Field Enough for Few-shot View Synthesis?
    Zhu, Hanxin
    He, Tianyu
    Li, Xin
    Li, Bingchen
    Chen, Zhibo
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 20288 - 20298
  • [3] CombiNeRF: A Combination of Regularization Techniques for Few-Shot Neural Radiance Field View Synthesis
    Bonotto, Matteo
    Sarrocco, Luigi
    Evangelista, Daniele
    Imperoli, Marco
    Pretto, Alberto
    2024 INTERNATIONAL CONFERENCE IN 3D VISION, 3DV 2024, 2024, : 641 - 650
  • [4] Few-Shot Neural Radiance Fields under Unconstrained Illumination
    Lee, SeokYeong
    Choi, JunYong
    Kim, Seungryong
    Kim, Ig-Jae
    Cho, Junghyun
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 4, 2024, : 2938 - 2946
  • [5] AE-NeRF: Audio Enhanced Neural Radiance Field for Few Shot Talking Head Synthesis
    Li, Dongze
    Zhao, Kang
    Wang, Wei
    Peng, Bo
    Zhang, Yingya
    Dong, Jing
    Tan, Tieniu
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 4, 2024, : 3037 - 3045
  • [6] SFDNeRF: A Semantic Feature-Driven Few-Shot Neural Radiance Field Framework with Hybrid Regularization
    Wang, Xing
    Zhang, Bin
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT VI, 2025, 15036 : 403 - 416
  • [7] FDNeRF: Few-shot Dynamic Neural Radiance Fields for Face Reconstruction and Expression Editing
    Zhang, Jingbo
    Li, Xiaoyu
    Wan, Ziyu
    Wang, Can
    Liao, Jing
    PROCEEDINGS SIGGRAPH ASIA 2022, 2022,
  • [8] Incremental Few-Shot Instance Segmentation
    Ganea, Dan Andrei
    Boom, Bas
    Poppe, Ronald
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 1185 - 1194
  • [9] Few-shot Incremental Event Detection
    Wang, Hao
    Shi, Hanwen
    Duan, Jianyong
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2024, 23 (02)
  • [10] Distributed Incremental Tensor Tucker Decomposition
    Yang K.-Y.
    Gao Y.-J.
    Chen L.
    Ge C.-C.
    Shen Y.-F.
    Jisuanji Xuebao/Chinese Journal of Computers, 2021, 44 (08): : 1696 - 1713