Hyperspectral Neural Radiance Field Method Based on Reference Spectrum

被引:0
|
作者
Ma, Runchuan [1 ]
He, Sailing [1 ,2 ]
机构
[1] Zhejiang Univ, Coll Opt Sci & Engn, Natl Engn Res Ctr Opt Instruments, Ctr Opt & Electromagnet Res, Hangzhou 310058, Peoples R China
[2] KTH Royal Inst Technol, Sch Elect Engn, Dept Electromagnet Engn, S-11428 Stockholm, Sweden
来源
IEEE ACCESS | 2024年 / 12卷
基金
中国国家自然科学基金;
关键词
Hyperspectral imaging; Neural radiance field; Neural networks; Vectors; Light sources; Training; Three-dimensional displays; 3D; hyperspectral imaging; NeRF; novel view synthesis; reference spectrum; TRANSMISSION;
D O I
10.1109/ACCESS.2024.3459917
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The Neural Radiance Field (NeRF) method for datasets is gaining attention for its wide applications and research value. Hyperspectral images have also gained many applications in recent years. This paper proposes a hyperspectral NeRF method based on reference spectrum, combines both NeRF and hyperspectral imaging. The method fully utilizes the features of hyperspectral data to obtain more consistent spectral characteristics and higher-quality synthesized images. Various experiments demonstrate that our method effectively improves the quality and spectral consistency of images generated at new angles of views with various training set sizes, compared with the original hyperspectral NeRF method. Additionally, the present method provides a convenient way to render images under different light sources with various spectra, expanding the potential applications of hyperspectral NeRF.
引用
收藏
页码:133018 / 133029
页数:12
相关论文
共 50 条
  • [31] ABLE-NeRF: Attention-Based Rendering with Learnable Embeddings for Neural Radiance Field
    Tang, Zhe Jun
    Cham, Tat-Jen
    Zhao, Haiyu
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 16559 - 16568
  • [32] LidaRF: Delving into Lidar for Neural Radiance Field on Street Scenes
    Sun, Shanlin
    Zhuang, Bingbing
    Jiang, Ziyu
    Liu, Buyu
    Xie, Xiaohui
    Chandraker, Manmohan
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 19563 - 19572
  • [33] Temporal Variation Model of Ultraviolet Hyperspectral Solar Reference Spectrum
    Pei Guo-chao
    Li Yuan
    Bai Ting-zhu
    SPECTROSCOPY AND SPECTRAL ANALYSIS, 2020, 40 (08) : 2332 - 2338
  • [34] Advancing Generalizable Occlusion Modeling for Neural Human Radiance Field
    Liu, Bingzheng
    Lei, Jianjun
    Peng, Bo
    Zhang, Zhe
    Zhu, Jie
    Huang, Qingming
    IEEE TRANSACTIONS ON MULTIMEDIA, 2025, 27 : 1362 - 1373
  • [35] NeRF-Texture: Synthesizing Neural Radiance Field Textures
    Huang, Yi-Hua
    Cao, Yan-Pei
    Lai, Yu-Kun
    Shan, Ying
    Gao, Lin
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (09) : 5986 - 6000
  • [36] Convolution Neural Network Based on Two-Dimensional Spectrum for Hyperspectral Image Classification
    Gao, Hongmin
    Lin, Shuo
    Yang, Yao
    Li, Chenming
    Yang, Mingxiang
    JOURNAL OF SENSORS, 2018, 2018
  • [37] 4D Portrait Generation based on Neural Radiance Field and Facial Expression Similarity
    Kimura, Fumiya
    Shishido, Hidehiko
    Kitahara, Itaru
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY, IWAIT 2023, 2023, 12592
  • [38] PointNeRF plus plus : A Multi-scale, Point-Based Neural Radiance Field
    Sun, Weiwei
    Trulls, Eduard
    Tseng, Yang-Che
    Sambandam, Sneha
    Sharma, Gopal
    Tagliasacchi, Andrea
    Yi, Kwang Moo
    COMPUTER VISION-ECCV 2024, PT XXXVIII, 2025, 15096 : 221 - 238
  • [39] Explicit Composition of Neural Radiance Fields by Learning an Occlusion Field
    Sun, Xunsen
    Zhu, Hao
    Lu, Yuanxun
    Cao, Xun
    ARTIFICIAL INTELLIGENCE, CICAI 2023, PT I, 2024, 14473 : 78 - 90
  • [40] Dynamic Neural Radiance Field from Defocused Monocular Video
    Luo, Xianrui
    Sun, Huiqiang
    Peng, Juewen
    Cao, Zhiguo
    COMPUTER VISION - ECCV 2024, PT V, 2025, 15063 : 142 - 159