WaterHE-NeRF: Water-ray matching neural radiance fields for underwater scene reconstruction

被引:0
|
作者
Zhou, Jingchun [1 ]
Liang, Tianyu [1 ]
Zhang, Dehuan [1 ]
Liu, Siyuan [2 ]
Wang, Junsheng [1 ]
Wu, Edmond Q. [3 ]
机构
[1] Dalian Maritime Univ, Sch Informat Sci & Technol, Dalian 116026, Liaoning, Peoples R China
[2] Dalian Maritime Univ, Dept Marine Engn, Dalian 116026, Liaoning, Peoples R China
[3] Shanghai Jiao Tong Univ, Dept Comp Sci & Engn, Shanghai 200240, Peoples R China
关键词
Underwater image; Image enhancement; Neural radiance field; Image fusion; IMAGE-ENHANCEMENT;
D O I
10.1016/j.inffus.2024.102770
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural Radiance Field (NeRF) technology demonstrates immense potential in novel viewpoint synthesis tasks due to its physics-based volumetric rendering process, which is particularly promising in underwater scenes. However, existing underwater NeRF methods face challenges in handling light attenuation caused by the water medium and the lack of real Ground Truth (GT) supervision. To address these issues, we propose WaterHE-NeRF, a novel approach incorporating a water-ray matching field developed based on Retinex theory. This field precisely encodes color, density, and illuminance attenuation in three-dimensional space. WaterHENeRF employs an illuminance attenuation mechanism to generate degraded and clear multi-view images, optimizing image restoration by combining reconstruction loss with Wasserstein distance. Furthermore, using histogram equalization (HE) as pseudo-GT, WaterHE-NeRF enhances the network's accuracy in preserving original details and color distribution. Extensive experiments on real underwater and synthetic datasets validate the effectiveness of WaterHE-NeRF.
引用
收藏
页数:17
相关论文
共 26 条
  • [21] Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Video
    Tretschk, Edgar
    Tewari, Ayush
    Golyanik, Vladislav
    Zollhofer, Michael
    Lassner, Christoph
    Theobalt, Christian
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 12939 - 12950
  • [22] OptiViewNeRF: Optimizing 3D reconstruction via batch view selection and scene uncertainty in Neural Radiance Fields
    Li, You
    Li, Rui
    Li, Ziwei
    Guo, Renzhong
    Tang, Shengjun
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2025, 136
  • [23] Enabling Rapid and High-Quality 3D Scene Reconstruction in Cystoscopy through Neural Radiance Fields
    Chen, Pengcheng
    Gunderson, Nicole M.
    Lewis, Andrew
    Speich, Jason R.
    Porter, Michael P.
    Seibel, Eric J.
    IMAGE-GUIDED PROCEDURES, ROBOTIC INTERVENTIONS, AND MODELING, MEDICAL IMAGING 2024, 2024, 12928
  • [24] Camera and LiDAR Fusion for Urban Scene Reconstruction and Novel View Synthesis via Voxel-Based Neural Radiance Fields
    Chen, Xuanzhu
    Song, Zhenbo
    Zhou, Jun
    Xie, Dong
    Lu, Jianfeng
    REMOTE SENSING, 2023, 15 (18)
  • [25] SonoNERFs: Neural Radiance Fields Applied to Biological Echolocation Systems Allow 3D Scene Reconstruction through Perceptual Prediction
    Jansen, Wouter
    Steckel, Jan
    BIOMIMETICS, 2024, 9 (06)
  • [26] EndoSelf: Self-supervised Monocular 3D Scene Reconstruction of Deformable Tissues with Neural Radiance Fields on Endoscopic Videos
    Li, Wenda
    Hayashi, Yuichiro
    Oda, Masahiro
    Kitasaka, Takayuki
    Misawa, Kazunari
    Mori, Kensaku
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT VI, 2024, 15006 : 241 - 251