Attention-based gating units separate channels in neural radiance fields

被引:0
|
作者
Yu, Chufei [1 ]
Su, Gongbing [2 ]
Yuan, Meng [1 ]
Zeng, Wenhao [1 ]
机构
[1] Department of Mechanical Engineering and Automation, Wuhan Textile University, Hubei, Wuhan, China
[2] Department of Mechanical Engineering and Automation, Hubei Key Laboratory of Digital Textile Equipment, Wuhan Textile University, Hubei, Wuhan, China
关键词
D O I
10.1504/IJWMC.2024.142084
中图分类号
学科分类号
摘要
We introduce a unique inductive bias to improve the reconstruction quality of Neural Radiance Fields (NeRF), NeRF employs the Fourier transform to map 3D coordinates to a highdimensional space, enhancing the representation of high-frequency information in scenes. However, this transformation often introduces significant noise, affecting NeRF's robustness. Our approach allocates attention effectively by segregating channels within NeRF using attention-based gating units. We conducted experiments on an open-source data set to demonstrate the effectiveness of our method, which leads to significant improvements in the quality of synthesised new-view images compared to state-of-the-art methods. Notably, we achieve an average PSNR increase of 0.17 compared to the original NeRF. Furthermore, our method is implemented through a carefully designed special Multi-Layer Perceptron (MLP) architecture, ensuring compatibility with most existing NeRF-based methods. © 2024 Inderscience Enterprises Ltd.
引用
收藏
页码:335 / 345
相关论文
共 50 条
  • [41] Chroma Intra Prediction With Lightweight Attention-Based Neural Networks
    Zou, Chengyi
    Wan, Shuai
    Ji, Tiannan
    Blanch, Marc Gorriz
    Mrak, Marta
    Herranz, Luis
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (01) : 549 - 560
  • [42] Attention-based deep neural network for driver behavior recognition
    Xiao, Weichu
    Liu, Hongli
    Ma, Ziji
    Chen, Weihong
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2022, 132 : 152 - 161
  • [43] NASABN: A Neural Architecture Search Framework for Attention-Based Networks
    Jing, Kun
    Xu, Jungang
    Xu, Hui
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [44] A Comparative Analysis of Generative Neural Attention-based Service Chatbot
    Suhaili, Sinarwati Mohamad
    Salim, Naomie
    Jambli, Mohamad Nazim
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (08) : 742 - 751
  • [45] Applied attention-based LSTM neural networks in stock prediction
    Cheng, Li-Chen
    Huang, Yu-Hsiang
    Wu, Mu-En
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 4716 - 4718
  • [46] Attention-based recurrent neural network for influenza epidemic prediction
    Zhu, Xianglei
    Fu, Bofeng
    Yang, Yaodong
    Ma, Yu
    Hao, Jianye
    Chen, Siqi
    Liu, Shuang
    Li, Tiegang
    Liu, Sen
    Guo, Weiming
    Liao, Zhenyu
    BMC BIOINFORMATICS, 2019, 20 (Suppl 18)
  • [47] Attention-Based Convolutional Neural Network for Earthquake Event Classification
    Ku, Bonhwa
    Kim, Gwantae
    Ahn, Jae-Kwang
    Lee, Jimin
    Ko, Hanseok
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (12) : 2057 - 2061
  • [48] Attention-based convolutional neural network for Bangla sentiment analysis
    Sadia Sharmin
    Danial Chakma
    AI & SOCIETY, 2021, 36 : 381 - 396
  • [49] Attention-based convolutional neural network for deep face recognition
    Hefei Ling
    Jiyang Wu
    Junrui Huang
    Jiazhong Chen
    Ping Li
    Multimedia Tools and Applications, 2020, 79 : 5595 - 5616
  • [50] Company Industry Classification with Neural and Attention-Based Learning Models
    Slavov, Stanislav
    Tagarev, Andrey
    Tulechki, Nikola
    Boytcheva, Svetla
    2019 BIG DATA, KNOWLEDGE AND CONTROL SYSTEMS ENGINEERING (BDKCSE), 2019,