Attention-based gating units separate channels in neural radiance fields

被引:0
|
作者
Yu, Chufei [1 ]
Su, Gongbing [2 ]
Yuan, Meng [1 ]
Zeng, Wenhao [1 ]
机构
[1] Department of Mechanical Engineering and Automation, Wuhan Textile University, Hubei, Wuhan, China
[2] Department of Mechanical Engineering and Automation, Hubei Key Laboratory of Digital Textile Equipment, Wuhan Textile University, Hubei, Wuhan, China
关键词
D O I
10.1504/IJWMC.2024.142084
中图分类号
学科分类号
摘要
We introduce a unique inductive bias to improve the reconstruction quality of Neural Radiance Fields (NeRF), NeRF employs the Fourier transform to map 3D coordinates to a highdimensional space, enhancing the representation of high-frequency information in scenes. However, this transformation often introduces significant noise, affecting NeRF's robustness. Our approach allocates attention effectively by segregating channels within NeRF using attention-based gating units. We conducted experiments on an open-source data set to demonstrate the effectiveness of our method, which leads to significant improvements in the quality of synthesised new-view images compared to state-of-the-art methods. Notably, we achieve an average PSNR increase of 0.17 compared to the original NeRF. Furthermore, our method is implemented through a carefully designed special Multi-Layer Perceptron (MLP) architecture, ensuring compatibility with most existing NeRF-based methods. © 2024 Inderscience Enterprises Ltd.
引用
收藏
页码:335 / 345
相关论文
共 50 条
  • [21] An attention-based convolutional neural network for recipe recommendation
    Jia, Nan
    Chen, Jie
    Wang, Rongzheng
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 201
  • [22] Dual separated attention-based graph neural network
    Shen, Xiao
    Choi, Kup-Sze
    Zhou, Xi
    NEUROCOMPUTING, 2024, 599
  • [23] Seizure localisation with attention-based graph neural networks
    Grattarola, Daniele
    Livi, Lorenzo
    Alippi, Cesare
    Wennberg, Richard
    Valiante, Taufik A.
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 203
  • [24] Attention-Based Convolutional Neural Network for Ingredients Identification
    Chen, Shi
    Li, Ruixue
    Wang, Chao
    Liang, Jiakai
    Yue, Keqiang
    Li, Wenjun
    Li, Yilin
    ENTROPY, 2023, 25 (02)
  • [25] Attention-based neural network for polarimetric image denoising
    Liu, Hedong
    Zhang, Yizhu
    Cheng, Zhenzhou
    Zhai, Jingsheng
    Hu, Haofeng
    OPTICS LETTERS, 2022, 47 (11) : 2726 - 2729
  • [26] Causal Discovery with Attention-Based Convolutional Neural Networks
    Nauta, Meike
    Bucur, Doina
    Seifert, Christin
    MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 2019, 1 (01):
  • [27] Retweet Prediction with Attention-based Deep Neural Network
    Zhang, Qi
    Gong, Yeyun
    Wu, Jindou
    Huang, Haoran
    Huang, Xuanjing
    CIKM'16: PROCEEDINGS OF THE 2016 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2016, : 75 - 84
  • [28] Attention-based Neural Network for Traffic Sign Detection
    Zhang, Jing
    Hui, Le
    Lu, Jianfeng
    Zhu, Yuhua
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 1839 - 1844
  • [29] Attention-Based Graph Neural Network for News Recommendation
    Ji, Zhenyan
    Wu, Mengdan
    Liu, Jirui
    Armendariz Inigo, Jose Enrique
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [30] Attention-Based Recurrent Neural Network for Multicriteria Recommendations
    Bougteb, Yahya
    Frikh, Bouchra
    Ouhbi, Brahim
    Zemmouri, El Moukhtar
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 2, INTELLISYS 2023, 2024, 823 : 264 - 274