A joint framework for underwater sequence images stitching based on deep neural network convolutional neural network

被引:8
|
作者
Sheng, Mingwei [1 ]
Tang, Songqi [1 ]
Cui, Zhuang [1 ]
Wu, Wanqi [1 ]
Wan, Lei [1 ]
机构
[1] Harbin Engn Univ, Sci & Technol Underwater Vehicle Lab, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Image stitching; AUV; underwater image; convolutional neural network; image enhancement; image registration; NAVIGATION;
D O I
10.1177/1729881420915062
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Panoramic stitching technology provides an effective solution for expanding visual detection range of the autonomous underwater vehicle. However, absorption and scattering of light in the water seriously deteriorate the underwater imaging in terms of distance and quality, especially the scattering sharply decreases the underwater image contrast and results in serious blur. This reduces the number of matching feature points between the underwater images to be stitched, while fewer matched points generated make image registration and stitching difficult. To solve the problem, a joint framework is established, which firstly involves a convolutional neural network-like algorithm composed of a symmetric convolution and deconvolution framework for underwater image enhancement. Then, it proposes an improved convolutional neural network-random sample consensus method based on VGGNet-16 framework to generate more correct matching feature points for image registration. The fusion method based on Laplacian pyramid is applied to eliminate artificial stitching traces and correct the position of stitching seam. Experimental results indicate that the proposed framework can restore the color and detail information of underwater images and generate more effective and sufficient matching feature points for underwater sequence images stitching.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Sports Sequence Images Based on Convolutional Neural Network
    Chen, Yonghao
    [J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2021, 2021
  • [2] Underwater object Images Classification Based on Convolutional Neural Network
    Zhu, Keqing
    Tian, Jie
    Huang, Haining
    [J]. 2018 IEEE 3RD INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING (ICSIP), 2018, : 301 - 305
  • [3] Deep Convolutional Neural Network based Ship Images Classification
    Mishra, Narendra Kumar
    Kumar, Ashok
    Choudhury, Kishor
    [J]. DEFENCE SCIENCE JOURNAL, 2021, 71 (02) : 200 - 208
  • [4] A Convolutional Neural Network and Graph Convolutional Network Based Framework for Classification of Breast Histopathological Images
    Gao, Zhiyang
    Lu, Zhiyang
    Wang, Jun
    Ying, Shihui
    Shi, Jun
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (07) : 3163 - 3173
  • [5] A Deep Convolutional Neural Network Based Framework for Pneumonia Detection
    Jamil, Sonain
    Abbas, Muhammad Sohail
    Fawad
    Zia, Muhammad Faisal
    Rahman, Muhib Ur
    [J]. 2021 INTERNATIONAL CONFERENCE ON DIGITAL FUTURES AND TRANSFORMATIVE TECHNOLOGIES (ICODT2), 2021,
  • [6] Design of underwater acoustic touchscreen based on deep convolutional neural network
    Wan, Haopeng
    Chen, Jiaming
    Li, Shuang
    Zou, Jijie
    Jia, Kangning
    Yuan, Peilong
    Sun, Feiyang
    Xu, Xiaodong
    Cheng, Liping
    Fan, Li
    Yan, Xuejun
    Li, Guokuan
    Chen, Xi
    Zhang, Haiou
    [J]. APPLIED ACOUSTICS, 2023, 203
  • [7] Polarization Information Restoration of Underwater Images Based on Deep Neural Network
    Liu Hedong
    Han Yilin
    Li Xiaobo
    Cheng Zhenzhou
    Liu Tiegen
    Zhai Jingsheng
    Hu Haofeng
    [J]. ACTA OPTICA SINICA, 2024, 44 (12)
  • [8] Deep Convolutional Neural Network for Correlating Images and Sentences
    Jia, Yuhua
    Bai, Liang
    Wang, Peng
    Guo, Jinlin
    Xie, Yuxiang
    [J]. MULTIMEDIA MODELING, MMM 2018, PT I, 2018, 10704 : 154 - 165
  • [9] A face sequence recognition method based on deep convolutional neural network
    Ma, Siwei
    Cao, Meng
    Li, Jiadong
    Zhu, Quanyin
    Li, Xiang
    Shen, Yi
    Wang, Mengdi
    [J]. 2019 18TH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS FOR BUSINESS ENGINEERING AND SCIENCE (DCABES 2019), 2019, : 100 - 103
  • [10] Ship detection in SAR images based on deep convolutional neural network
    Yang L.
    Su J.
    Li X.
    [J]. Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2019, 41 (09): : 1990 - 1997