Attention-based gating units separate channels in neural radiance fields

被引:0
|
作者
Yu, Chufei [1 ]
Su, Gongbing [2 ]
Yuan, Meng [1 ]
Zeng, Wenhao [1 ]
机构
[1] Department of Mechanical Engineering and Automation, Wuhan Textile University, Hubei, Wuhan, China
[2] Department of Mechanical Engineering and Automation, Hubei Key Laboratory of Digital Textile Equipment, Wuhan Textile University, Hubei, Wuhan, China
关键词
D O I
10.1504/IJWMC.2024.142084
中图分类号
学科分类号
摘要
We introduce a unique inductive bias to improve the reconstruction quality of Neural Radiance Fields (NeRF), NeRF employs the Fourier transform to map 3D coordinates to a highdimensional space, enhancing the representation of high-frequency information in scenes. However, this transformation often introduces significant noise, affecting NeRF's robustness. Our approach allocates attention effectively by segregating channels within NeRF using attention-based gating units. We conducted experiments on an open-source data set to demonstrate the effectiveness of our method, which leads to significant improvements in the quality of synthesised new-view images compared to state-of-the-art methods. Notably, we achieve an average PSNR increase of 0.17 compared to the original NeRF. Furthermore, our method is implemented through a carefully designed special Multi-Layer Perceptron (MLP) architecture, ensuring compatibility with most existing NeRF-based methods. © 2024 Inderscience Enterprises Ltd.
引用
收藏
页码:335 / 345
相关论文
共 50 条
  • [1] ABLE-NeRF: Attention-Based Rendering with Learnable Embeddings for Neural Radiance Field
    Tang, Zhe Jun
    Cham, Tat-Jen
    Zhao, Haiyu
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 16559 - 16568
  • [2] Attention-Based Gating Network for Robust Segmentation Tracking
    Yang, Yijin
    Gu, Xiaodong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (01) : 245 - 258
  • [3] Attention-Based Neural Text Segmentation
    Badjatiya, Pinkesh
    Kurisinkel, Litton J.
    Gupta, Manish
    Varma, Vasudeva
    ADVANCES IN INFORMATION RETRIEVAL (ECIR 2018), 2018, 10772 : 180 - 193
  • [4] Attention-based Neural Cellular Automata
    Tesfaldet, Mattie
    Nowrouzezahrai, Derek
    Pal, Christopher
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [5] Attention-Based Neural Tag Recommendation
    Yuan, Jiahao
    Jin, Yuanyuan
    Liu, Wenyan
    Wang, Xiaoling
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2019), PT II, 2019, 11447 : 350 - 365
  • [6] GNeRF: Accelerating Neural Radiance Fields Inference via Adaptive Sample Gating
    Gu, Cheng
    Li, Gang
    Lin, Xiaolong
    Ling, Jiayao
    Liang, Xiaoyao
    2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024, 2024,
  • [7] Neutron: an attention-based neural decompiler
    Liang, Ruigang
    Cao, Ying
    Hu, Peiwei
    Chen, Kai
    CYBERSECURITY, 2021, 4 (01)
  • [8] Neutron: an attention-based neural decompiler
    Ruigang Liang
    Ying Cao
    Peiwei Hu
    Kai Chen
    Cybersecurity, 4
  • [9] A Neural Autoregressive Approach to Attention-based Recognition
    Zheng, Yin
    Zemel, Richard S.
    Zhang, Yu-Jin
    Larochelle, Hugo
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 113 (01) : 67 - 79
  • [10] A Hierarchical Neural Attention-based Text Classifier
    Sinha, Koustuv
    Dong, Yue
    Cheung, Jackie C. K.
    Ruths, Derek
    2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), 2018, : 817 - 823