Scene 3-D Reconstruction System in Scattering Medium

被引:0
|
作者
Zhang, Zhuoyifan [1 ]
Zhang, Lu [2 ]
Wang, Liang [3 ]
Wu, Haoming [2 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Artificial Intelligence, Beijing 100876, Peoples R China
[2] Hainan Univ, Sch Informat & Commun Engn, Haikou 570228, Peoples R China
[3] Hainan Univ, Sch Comp Sci & Technol, Haikou 570228, Peoples R China
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2024年 / 80卷 / 02期
基金
中国国家自然科学基金; 海南省自然科学基金;
关键词
Underwater scene reconstruction; image enhancement; NeRF; ENHANCEMENT;
D O I
10.32604/cmc.2024.052144
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Research on neural radiance fields for novel view synthesis has experienced explosive growth with the development of new models and extensions. The NeRF (Neural Radiance Fields) algorithm, suitable for underwater scenes or scattering media, is also evolving. Existing underwater 3D reconstruction systems still face challenges such as long training times and low rendering efficiency. This paper proposes an improved underwater 3D reconstruction system to achieve rapid and high-quality 3D reconstruction. First, we enhance underwater videos captured by a monocular camera to correct the image quality degradation caused by the physical properties of the water medium and ensure consistency in enhancement across frames. Then, we perform keyframe selection to optimize resource usage and reduce the impact of dynamic objects on the reconstruction results. After pose estimation using COLMAP, the selected keyframes undergo 3D reconstruction using neural radiance fields (NeRF) based on multiresolution hash encoding for model construction and rendering. In terms of image enhancement, our method has been optimized in certain scenarios, demonstrating effectiveness in image enhancement and better continuity between consecutive frames of the same data. In terms of 3D reconstruction, our method achieved a peak signalto-noise ratio (PSNR) of 18.40 dB and a structural similarity (SSIM) of 0.6677, indicating a good balance between operational efficiency and reconstruction quality.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Scene 3-D Reconstruction System in Scattering Medium
    Zhang, Zhuoyifan
    Zhang, Lu
    Wang, Liang
    Wu, Haoming
    [J]. arXiv, 2023,
  • [2] A conical panoramic stereo imaging system for 3-d scene reconstruction
    Firoozfam, P
    Negahdaripour, S
    Barufaldi, C
    [J]. OCEANS 2003 MTS/IEEE: CELEBRATING THE PAST...TEAMING TOWARD THE FUTURE, 2003, : 2303 - 2308
  • [3] Selective reconstruction of a 3-D scene with an active stereo vision system
    Okubo, A
    Nishikawa, A
    Miyazaki, F
    [J]. 1997 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION - PROCEEDINGS, VOLS 1-4, 1997, : 751 - 758
  • [4] Outdoor Dynamic 3-D Scene Reconstruction
    Kim, Hansung
    Guillemaut, Jean-Yves
    Takai, Takeshi
    Sarim, Muhammad
    Hilton, Adrian
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2012, 22 (11) : 1611 - 1622
  • [5] Reconstruction of Temperature Field in 3-D, Absorbing, Emitting, and Anisotropically Scattering Medium
    赵敬德
    刘妮
    钟珂
    [J]. Journal of Donghua University(English Edition), 2006, (02) : 17 - 21
  • [6] 3-D Reconstruction System
    Cseri, O. E.
    Kerti, A.
    Vamossy, Z.
    [J]. 2009 7TH INTERNATIONAL SYMPOSIUM ON INTELLIGENT SYSTEMS AND INFORMATICS, 2009, : 156 - 160
  • [7] 3-D scene reconstruction with viewpoint adaptation on stereo displays
    Redert, A
    Hendriks, E
    Biemond, J
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2000, 10 (04) : 550 - 562
  • [8] Towards 3-D scene reconstruction from broadcast video
    Imre, Evren
    Knorr, Sebastian
    Ozkalayci, Burak
    Topay, Ugur
    Alatan, A. Aydin
    Sikora, Thomas
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2007, 22 (02) : 108 - 126
  • [9] On the development of an active vision system for 3-D scene reconstruction and analysis from underwater images
    Strickrott, JA
    Negahdaripour, S
    [J]. OCEANS '97 MTS/IEEE CONFERENCE PROCEEDINGS, VOLS 1 AND 2, 1997, : 626 - 633
  • [10] A scene analysis system for the generation of 3-D models
    Grau, O
    [J]. INTERNATIONAL CONFERENCE ON RECENT ADVANCES IN 3-D DIGITAL IMAGING AND MODELING, PROCEEDINGS, 1997, : 221 - 228