Attention-based gating units separate channels in neural radiance fields

被引:0
|
作者
Yu, Chufei [1 ]
Su, Gongbing [2 ]
Yuan, Meng [1 ]
Zeng, Wenhao [1 ]
机构
[1] Department of Mechanical Engineering and Automation, Wuhan Textile University, Hubei, Wuhan, China
[2] Department of Mechanical Engineering and Automation, Hubei Key Laboratory of Digital Textile Equipment, Wuhan Textile University, Hubei, Wuhan, China
关键词
D O I
10.1504/IJWMC.2024.142084
中图分类号
学科分类号
摘要
We introduce a unique inductive bias to improve the reconstruction quality of Neural Radiance Fields (NeRF), NeRF employs the Fourier transform to map 3D coordinates to a highdimensional space, enhancing the representation of high-frequency information in scenes. However, this transformation often introduces significant noise, affecting NeRF's robustness. Our approach allocates attention effectively by segregating channels within NeRF using attention-based gating units. We conducted experiments on an open-source data set to demonstrate the effectiveness of our method, which leads to significant improvements in the quality of synthesised new-view images compared to state-of-the-art methods. Notably, we achieve an average PSNR increase of 0.17 compared to the original NeRF. Furthermore, our method is implemented through a carefully designed special Multi-Layer Perceptron (MLP) architecture, ensuring compatibility with most existing NeRF-based methods. © 2024 Inderscience Enterprises Ltd.
引用
收藏
页码:335 / 345
相关论文
共 50 条
  • [31] Signal Peptides Generated by Attention-Based Neural Networks
    Wu, Zachary
    Yang, Kevin K.
    Liszka, Michael J.
    Lee, Alycia
    Batzilla, Alina
    Wernick, David
    Weiner, David P.
    Arnold, Frances H.
    ACS SYNTHETIC BIOLOGY, 2020, 9 (08): : 2154 - 2161
  • [32] Attention-based Recurrent Neural Network for Location Recommendation
    Xia, Bin
    Li, Yun
    Li, Qianmu
    Li, Tao
    2017 12TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS AND KNOWLEDGE ENGINEERING (IEEE ISKE), 2017,
  • [33] Attention-Based Recurrent Neural Network for Sequence Labeling
    Li, Bofang
    Liu, Tao
    Zhao, Zhe
    Du, Xiaoyong
    WEB AND BIG DATA (APWEB-WAIM 2018), PT I, 2018, 10987 : 340 - 348
  • [34] A Unifying Framework of Attention-Based Neural Load Forecasting
    Xiong, Jing
    Zhang, Yu
    IEEE ACCESS, 2023, 11 : 51606 - 51616
  • [35] Local Pose Optimization with an Attention-based Neural Network
    Liu, Yiling
    Wang, Hesheng
    Xu, Fan
    Wang, Yong
    Chen, Weidong
    Tang, Qirong
    2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2019, : 3084 - 3089
  • [36] Demystifying Oversmoothing in Attention-Based Graph Neural Networks
    Wu, Xinyi
    Ajorlou, Amir
    Wu, Zihui
    Jadbabaie, Ali
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [37] An attention-based view on managing information processing channels in organizations
    Holm, Desiree Blankenburg
    Drogendijk, Rian
    ul Haq, Hammad
    SCANDINAVIAN JOURNAL OF MANAGEMENT, 2020, 36 (02)
  • [38] WaveNeRF: Wavelet-based Generalizable Neural Radiance Fields
    Xu, Muyu
    Zhan, Fangneng
    Zhang, Jiahui
    Yu, Yingchen
    Zhang, Xiaoqin
    Theobalt, Christian
    Shao, Ling
    Lu, Shijian
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 18149 - 18158
  • [39] Neural Radiance Fields with Regularizer Based on Differences of Neighboring Pixels
    Fukuda, Kohei
    Kurita, Takio
    Aizawa, Hiroaki
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [40] Neural Machine Translation Models with Attention-Based Dropout Layer
    Israr, Huma
    Khan, Safdar Abbas
    Tahir, Muhammad Ali
    Shahzad, Muhammad Khuram
    Ahmad, Muneer
    Zain, Jasni Mohamad
    CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 75 (02): : 2981 - 3009