Scene 3-D Reconstruction System in Scattering Medium

被引:0
|
作者
Zhang, Zhuoyifan [1 ]
Zhang, Lu [2 ]
Wang, Liang [3 ]
Wu, Haoming [2 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Artificial Intelligence, Beijing 100876, Peoples R China
[2] Hainan Univ, Sch Informat & Commun Engn, Haikou 570228, Peoples R China
[3] Hainan Univ, Sch Comp Sci & Technol, Haikou 570228, Peoples R China
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2024年 / 80卷 / 02期
基金
中国国家自然科学基金; 海南省自然科学基金;
关键词
Underwater scene reconstruction; image enhancement; NeRF; ENHANCEMENT;
D O I
10.32604/cmc.2024.052144
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Research on neural radiance fields for novel view synthesis has experienced explosive growth with the development of new models and extensions. The NeRF (Neural Radiance Fields) algorithm, suitable for underwater scenes or scattering media, is also evolving. Existing underwater 3D reconstruction systems still face challenges such as long training times and low rendering efficiency. This paper proposes an improved underwater 3D reconstruction system to achieve rapid and high-quality 3D reconstruction. First, we enhance underwater videos captured by a monocular camera to correct the image quality degradation caused by the physical properties of the water medium and ensure consistency in enhancement across frames. Then, we perform keyframe selection to optimize resource usage and reduce the impact of dynamic objects on the reconstruction results. After pose estimation using COLMAP, the selected keyframes undergo 3D reconstruction using neural radiance fields (NeRF) based on multiresolution hash encoding for model construction and rendering. In terms of image enhancement, our method has been optimized in certain scenarios, demonstrating effectiveness in image enhancement and better continuity between consecutive frames of the same data. In terms of 3D reconstruction, our method achieved a peak signalto-noise ratio (PSNR) of 18.40 dB and a structural similarity (SSIM) of 0.6677, indicating a good balance between operational efficiency and reconstruction quality.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Vision system for fast 3-D model reconstruction
    Lin, HY
    Subbarao, M
    [J]. OPTICAL ENGINEERING, 2004, 43 (07) : 1651 - 1664
  • [22] 3-D face image acquisition and reconstruction system
    Xu, Y
    Xu, CS
    Tian, YL
    Ma, SD
    Luo, ML
    [J]. WHERE INSTRUMENTATION IS GOING - CONFERENCE PROCEEDINGS, VOLS 1 AND 2, 1998, : 1121 - 1126
  • [23] Stereoscopic system for 3-D seabed mosaic reconstruction
    Leone, A.
    Diraco, G.
    Distante, C.
    [J]. 2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, : 1105 - 1108
  • [24] Pursuing 3-D Scene Structures With Optical Satellite Images From Affine Reconstruction to Euclidean Reconstruction
    Wang, Pinhe
    Shi, Limin
    Chen, Bao
    Hu, Zhanyi
    Qiao, Jianzhong
    Dong, Qiulei
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [25] 3-D surface reconstruction in automatic recognition system
    Matveev, IA
    Murynin, AB
    [J]. 23RD INTERNATIONAL CONGRESS ON HIGH-SPEED PHOTOGRAPHY AND PHOTONICS, PT 1, 1999, 3516 : 417 - 425
  • [26] Rapid 3-D video/laser sensing and digital archiving with immediate on-scene feedback for 3-D crime scene mass disaster data collection and reconstruction
    Altschuler, BR
    Oliver, WR
    Altschuler, MD
    [J]. TOOLS AND TECHNIQUES FOR MODELING AND SIMULATION, 24TH AIPR WORKSHOP, 1996, 2645 : 32 - 38
  • [27] 3-D Scattering Image Sparse Reconstruction via Radar Network
    Kang, Le
    Luo, Ying
    Zhang, Qun
    Liu, Xiao-Wen
    Liang, Bi-Shuai
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [28] TOMOGRAPHIC AND PROJECTIVE RECONSTRUCTION OF 3-D IMAGE DETAIL IN INVERSE SCATTERING
    FARHAT, NH
    CHU, TH
    WERNER, CL
    [J]. PROCEEDINGS OF THE SOCIETY OF PHOTO-OPTICAL INSTRUMENTATION ENGINEERS, 1984, 422 : 82 - 88
  • [29] Usability of aerial video footage for 3-D scene reconstruction and structural damage assessment
    Cusicanqui, Johnny
    Kerle, Norman
    Nex, Francesco
    [J]. NATURAL HAZARDS AND EARTH SYSTEM SCIENCES, 2018, 18 (06) : 1583 - 1598
  • [30] 3-D SCENE RECONSTRUCTION FROM NOISY IMAGE SEQUENCES USING DATA FUSION
    HONG, L
    BRZAKOVIC, D
    [J]. CONTROL ENGINEERING PRACTICE, 1994, 2 (05) : 825 - 831