Hyperspectral Neural Radiance Field Method Based on Reference Spectrum

被引:0
|
作者
Ma, Runchuan [1 ]
He, Sailing [1 ,2 ]
机构
[1] Zhejiang Univ, Coll Opt Sci & Engn, Natl Engn Res Ctr Opt Instruments, Ctr Opt & Electromagnet Res, Hangzhou 310058, Peoples R China
[2] KTH Royal Inst Technol, Sch Elect Engn, Dept Electromagnet Engn, S-11428 Stockholm, Sweden
来源
IEEE ACCESS | 2024年 / 12卷
基金
中国国家自然科学基金;
关键词
Hyperspectral imaging; Neural radiance field; Neural networks; Vectors; Light sources; Training; Three-dimensional displays; 3D; hyperspectral imaging; NeRF; novel view synthesis; reference spectrum; TRANSMISSION;
D O I
10.1109/ACCESS.2024.3459917
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The Neural Radiance Field (NeRF) method for datasets is gaining attention for its wide applications and research value. Hyperspectral images have also gained many applications in recent years. This paper proposes a hyperspectral NeRF method based on reference spectrum, combines both NeRF and hyperspectral imaging. The method fully utilizes the features of hyperspectral data to obtain more consistent spectral characteristics and higher-quality synthesized images. Various experiments demonstrate that our method effectively improves the quality and spectral consistency of images generated at new angles of views with various training set sizes, compared with the original hyperspectral NeRF method. Additionally, the present method provides a convenient way to render images under different light sources with various spectra, expanding the potential applications of hyperspectral NeRF.
引用
收藏
页码:133018 / 133029
页数:12
相关论文
共 50 条
  • [1] Precision detection method for ship shell plate molding based on neural radiance field
    Zhang, Xinhang
    Chang, Daofang
    Ma, Yanjun
    Du, Jiwang
    OCEAN ENGINEERING, 2024, 309
  • [2] An RRAM-based Neural Radiance Field Processor
    Zheng, Yueyang
    Rao, Chaolin
    Wan, Haochuan
    Zhou, Yuliang
    Zhou, Pingqiang
    Yu, Jingyi
    Lou, Xin
    2022 IEEE 35TH INTERNATIONAL SYSTEM-ON-CHIP CONFERENCE (IEEE SOCC 2022), 2022, : 305 - 309
  • [3] Instance Neural Radiance Field
    Liu, Yichen
    Hu, Benran
    Huang, Junkai
    Tai, Yu-Wing
    Tang, Chi-Keung
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 787 - 796
  • [4] Neural Articulated Radiance Field
    Noguchi, Atsuhiro
    Sun, Xiao
    Lin, Stephen
    Harada, Tatsuya
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 5742 - 5752
  • [5] Multimodal Neural Radiance Field
    Zhu, Haidong
    Sun, Yuyin
    Liu, Chi
    Xia, Lu
    Luo, Jiajia
    Qiao, Nan
    Nevatia, Ram
    Kuo, Cheng-Hao
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023), 2023, : 9393 - 9399
  • [6] Ev-NeRF: Event Based Neural Radiance Field
    Hwang, Inwoo
    Kim, Junho
    Kim, Young Min
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 837 - 847
  • [7] SpectralNeRF: Physically Based Spectral Rendering with Neural Radiance Field
    Li, Ru
    Liu, Jia
    Liu, Guanghui
    Zhang, Shengping
    Zeng, Bing
    Liu, Shuaicheng
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 4, 2024, : 3154 - 3162
  • [8] Loop Detection Method Based on Neural Radiance Field BoW Model for Visual Inertial Navigation of UAVs
    Zhang, Xiaoyue
    Cui, Yue
    Ren, Yanchao
    Duan, Guodong
    Zhang, Huanrui
    REMOTE SENSING, 2024, 16 (16)
  • [9] MarkNeRF: Watermarking for Neural Radiance Field
    Chen, Lifeng
    Liu, Jia
    Sun, Wenquan
    Dong, Weina
    Pan, Xiaozhong
    CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 80 (01): : 1235 - 1250
  • [10] Deformation Detection Method for Building Structures Based on Neural Radiance Fields
    Chen, Yanhang
    Zhang, Xinfeng
    Zhu, Jiakang
    Zhou, Chenwei
    Li, Gen
    PROCEEDINGS OF 2024 INTERNATIONAL CONFERENCE ON COMPUTER AND MULTIMEDIA TECHNOLOGY, ICCMT 2024, 2024, : 370 - 375