Object measurement in real underwater environments using improved stereo matching with semantic segmentation

被引:6
|
作者
Zhang, Jiawei [1 ]
Han, Fenglei [1 ]
Han, Duanfeng [1 ]
Su, Zhihao [1 ]
Li, Hansheng [1 ]
Zhao, Wangyuan [1 ]
Yang, Jianfeng [1 ]
机构
[1] Harbin Engn Univ, Dept Naval Architecture & Ocean Engn, 145 Nantong St, Harbin 150020, Heilongjiang, Peoples R China
关键词
Marine structure measurement; Underwater extreme environments; Stereo matching; Image progress; Semantic segmentation; ADAPTIVE HISTOGRAM EQUALIZATION; NET;
D O I
10.1016/j.measurement.2023.113147
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Accurately measuring distances in underwater environments is critical for applications such as underwater exploration and maintenance of underwater structures, but is limited by underwater environmental factors. To address this challenge, semantic segmentation and visual stereo matching are promising methods to achieve this goal. In this paper, we proposed a combination of Retinex and Curvature filter for image enhancement, and a modified SGBM (Semi-Global Block Matching) method using dilated SAD(sum of absolute differences) window and the dynamic disparity range obtained using semantic segmentation results to accelerate stereo matching, while also providing insight into the content of the sensed scene. By using the method we proposed, the measurement error is significantly reduced, even in extreme environments with low visibility and complex backgrounds. It showed strong adaptability when dealing with irregular shape objects, and sped up the calculation speed of the algorithm by reducing the calculation area. In the comparison experiment, we found that the error of SGBM with our image enhancement was reduced to 22.8%. By using our stereo matching algorithm, the error was further reduced to 6.2%, demonstrating its superiority for underwater measurement tasks. Our approach offered an efficient solution for autonomous distance measurement in challenging underwater environments.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Improved Scan Matching Performance in Snowy Environments Using Semantic Segmentation
    Obuchi, Masahiro
    Emaru, Takanori
    Ravankar, Ankit A.
    2021 IEEE/SICE INTERNATIONAL SYMPOSIUM ON SYSTEM INTEGRATION (SII), 2021, : 702 - 703
  • [2] Real-time object segmentation using disparity map of stereo matching
    Han, Dongil
    Lee, Byoungmoo
    Cho, Jae Il
    Hwang, Dae-Hwan
    APPLIED MATHEMATICS AND COMPUTATION, 2008, 205 (02) : 770 - 777
  • [3] Stereo SLAM in Dynamic Environments Using Semantic Segmentation
    Ai, Yongbao
    Sun, Qianchong
    Xi, Zhipeng
    Li, Na
    Dong, Jianmeng
    Wang, Xiang
    ELECTRONICS, 2023, 12 (14)
  • [4] Object Stereo-Joint Stereo Matching and Object Segmentation
    Bleyer, Michael
    Rother, Carsten
    Kohli, Pushmeet
    Scharstein, Daniel
    Sinha, Sudipta
    2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011,
  • [5] Adaptive hierarchical stereo matching using object segmentation and window warping
    Lee, HK
    Kim, JC
    Kim, YT
    Ha, YH
    STEREOSCOPIC DISPLAYS AND VIRTUAL REALITY SYSTEMS IX, 2002, 4660 : 358 - 366
  • [6] Adaptive hierarchical stereo matching using object segmentation and window warping
    Kim, JC
    Kang, BH
    Cho, MS
    2001 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS, VOLS 1-5: E-SYSTEMS AND E-MAN FOR CYBERNETICS IN CYBERSPACE, 2002, : 2295 - 2300
  • [7] Underwater Unsupervised Stereo Matching Method Based on Semantic Attention
    Li, Qing
    Wang, Hongjian
    Xiao, Yao
    Yang, Hualong
    Chi, Zhikang
    Dai, Dongchen
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2024, 12 (07)
  • [8] Research on underwater stereo matching method based on color segmentation
    Zhang Q.
    Lu S.
    Li H.
    Li Y.
    Zhang W.
    Li, Haibin (hbli@ysu.edu.cn), 1600, Chinese Optical Society (36):
  • [9] Feature Cascade Underwater Object Detection Based on Stereo Segmentation
    Kong, Weiyi
    Yang, Menglong
    Huang, Qinzhen
    JOURNAL OF COASTAL RESEARCH, 2020, : 140 - 144
  • [10] A Deep Learning Framework for Semantic Segmentation of Underwater Environments
    Smith, Amos
    Coffelt, Jeremy
    Lingemann, Kai
    2022 OCEANS HAMPTON ROADS, 2022,