Hyperspectral Neural Radiance Field Method Based on Reference Spectrum

被引:0
|
作者
Ma, Runchuan [1 ]
He, Sailing [1 ,2 ]
机构
[1] Zhejiang Univ, Coll Opt Sci & Engn, Natl Engn Res Ctr Opt Instruments, Ctr Opt & Electromagnet Res, Hangzhou 310058, Peoples R China
[2] KTH Royal Inst Technol, Sch Elect Engn, Dept Electromagnet Engn, S-11428 Stockholm, Sweden
来源
IEEE ACCESS | 2024年 / 12卷
基金
中国国家自然科学基金;
关键词
Hyperspectral imaging; Neural radiance field; Neural networks; Vectors; Light sources; Training; Three-dimensional displays; 3D; hyperspectral imaging; NeRF; novel view synthesis; reference spectrum; TRANSMISSION;
D O I
10.1109/ACCESS.2024.3459917
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The Neural Radiance Field (NeRF) method for datasets is gaining attention for its wide applications and research value. Hyperspectral images have also gained many applications in recent years. This paper proposes a hyperspectral NeRF method based on reference spectrum, combines both NeRF and hyperspectral imaging. The method fully utilizes the features of hyperspectral data to obtain more consistent spectral characteristics and higher-quality synthesized images. Various experiments demonstrate that our method effectively improves the quality and spectral consistency of images generated at new angles of views with various training set sizes, compared with the original hyperspectral NeRF method. Additionally, the present method provides a convenient way to render images under different light sources with various spectra, expanding the potential applications of hyperspectral NeRF.
引用
收藏
页码:133018 / 133029
页数:12
相关论文
共 50 条
  • [21] Adaptive Shells for Efficient Neural Radiance Field Rendering
    Wang, Zian
    Shen, Tianchang
    Nimier-David, Merlin
    Sharp, Nicholas
    Gao, Jun
    Keller, Alexander
    Fidler, Sanja
    Muller, Thomas
    Gojcic, Zan
    ACM TRANSACTIONS ON GRAPHICS, 2023, 42 (06):
  • [22] Nerfstudio: A Modular Framework for Neural Radiance Field Development
    Tancik, Matthew
    Weber, Ethan
    Ng, Evonne
    Li, Ruilong
    Yi, Brent
    Kerr, Justin
    Wang, Terrance
    Kristofferson, Alexander
    Austin, Jake
    Salahi, Kamyar
    Ahuja, Abhik
    McAllister, David
    Kanazawa, Angjoo
    PROCEEDINGS OF SIGGRAPH 2023 CONFERENCE PAPERS, SIGGRAPH 2023, 2023,
  • [23] Generalizable Neural Radiance Field with Hierarchical Geometry Constraint
    Zhang, Qinyi
    Xie, Jin
    Yang, Hang
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT II, 2024, 14426 : 319 - 330
  • [24] Fast 3D Reconstruction of UAV Images Based on Neural Radiance Field
    Jiang, Cancheng
    Shao, Hua
    APPLIED SCIENCES-BASEL, 2023, 13 (18):
  • [25] ClimateNeRF: Extreme Weather Synthesis in Neural Radiance Field
    Li, Yuan
    Lin, Zhi-Hao
    Forsyth, David
    Huang, Jia-Bin
    Wang, Shenlong
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 3204 - 3215
  • [26] 3D reconstruction based on neural radiance field structure ambiguity optimization
    Shi, Chao
    Deng, Huiping
    Xiang, Shen
    Wu, Jin
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2024, 39 (11) : 1483 - 1493
  • [27] Neural Radiance Field Dynamic Scene SLAM Based on Ray Segmentation and Bundle Adjustment
    Zhang, Yuquan
    Feng, Guosheng
    SENSORS, 2025, 25 (06)
  • [28] Neural Differential Radiance Field: Learning the Differential Space Using a Neural Network
    Hadadan, Saeed
    Zwicker, Matthias
    ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT I, 2024, 14495 : 93 - 104
  • [29] A fast classification method for hyperspectral imagery based on SOFM neural network
    Chen, De-Rong
    Tao, Peng
    Gong, Jiu-Lu
    Fan, Ning-Jun
    Binggong Xuebao/Acta Armamentarii, 2009, 30 (02): : 165 - 169
  • [30] Efficient classification method for hyperspectral images based on spiking neural network
    Qu, Haicheng
    Mu, Minjia
    Shan, Yimeng
    JOURNAL OF APPLIED REMOTE SENSING, 2024, 18 (03)