INCREMENTAL TENSOR DECOMPOSITION FOR FEW SHOT NEURAL RADIANCE FIELD

被引:0
|
作者
Li, Qian [1 ]
Wen, Cheng [2 ]
Fu, Rao [1 ]
机构
[1] Inria, Paris, France
[2] Univ Sydney, Camperdown, NSW, Australia
关键词
Novel View Synthesis; Tensor Decomposition; Few Shot Neural Radiance Field;
D O I
10.1109/ICASSP48485.2024.10445915
中图分类号
学科分类号
摘要
Neural Radiance Field (NeRF) stands out by demonstrating photo-realistic renderings, while it suffers from quality degradation when given only a few shot inputs. This paper aims to improve the rendering quality of NeRF from a few shot inputs. Original NeRF tends to overfit input views rapidly at the initial training stage when trained on sparse inputs. We address this challenge by presenting a novel incremental tensor decomposition method, where the resolution of decomposed tensors increases with the training iteration, enabling coarse to fine learning and alleviating the overfitting during the early stage. We offer several regularizations based on the proposed incremental learning process, including patch-based density regularization and depth regularization. Our proposed method outperforms previous baselines on the Realistic Synthetic 360 degrees dataset and achieves state-of-the-art results in PSNR.
引用
收藏
页码:3730 / 3734
页数:5
相关论文
共 50 条
  • [41] Pseudo initialization based Few-Shot Class Incremental Learning
    Shao, Mingwen
    Zhuang, Xinkai
    Zhang, Lixu
    Zuo, Wangmeng
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 247
  • [42] An Incremental Malware Classification Approach Based on Few-Shot Learning
    Qiang, Qian
    Cheng, Mian
    Hu, Yang
    Zhou, Yuan
    Sun, Jiawei
    Ding, Yu
    Qi, Zisen
    Jiao, Fei
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 2682 - 2687
  • [43] Few-Shot Class Incremental Learning with Generative Feature Replay
    Shankarampeta, Abhilash Reddy
    Yamauchi, Koichiro
    PROCEEDINGS OF THE 10TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION APPLICATIONS AND METHODS (ICPRAM), 2021, : 259 - 267
  • [44] NTK-Guided Few-Shot Class Incremental Learning
    Liu, Jingren
    Ji, Zhong
    Pang, Yanwei
    Yu, Yunlong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 6029 - 6044
  • [45] Class similarity weighted knowledge distillation for few shot incremental learning
    Akmel, Feidu
    Meng, Fanman
    Wu, Qingbo
    Chen, Shuai
    Zhang, Runtong
    Assefa, Maregu
    NEUROCOMPUTING, 2024, 584
  • [46] iFS-RCNN: An Incremental Few-shot Instance Segmenter
    Khoi Nguyen
    Todorovic, Sinisa
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 7000 - 7009
  • [47] Dynamic Support Network for Few-Shot Class Incremental Learning
    Yang, Boyu
    Lin, Mingbao
    Zhang, Yunxiao
    Liu, Binghao
    Liang, Xiaodan
    Ji, Rongrong
    Ye, Qixiang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) : 2945 - 2951
  • [48] Grassmann Graph Embedding for Few-Shot Class Incremental Learning
    Gu, Ziqi
    Xu, Chunyan
    Cui, Zhen
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT VIII, 2024, 14432 : 179 - 191
  • [49] Incremental few-shot object detection via knowledge transfer
    Feng, Hangtao
    Zhang, Lu
    Yang, Xu
    Liu, Zhiyong
    PATTERN RECOGNITION LETTERS, 2022, 156 : 67 - 73
  • [50] Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesis
    Shen, Shuai
    Li, Wanhua
    Zhu, Zheng
    Duan, Yueqi
    Zhou, Jie
    Lu, Jiwen
    COMPUTER VISION, ECCV 2022, PT XII, 2022, 13672 : 666 - 682