Multi-view underwater image enhancement method via embedded fusion mechanism

被引:108
|
作者
Zhou, Jingchun [1 ]
Sun, Jiaming [1 ]
Zhang, Weishi [1 ]
Lin, Zifan [2 ]
机构
[1] Dalian Maritime Univ DMU, Coll Informat Sci & Technol, Dalian 116026, Peoples R China
[2] Univ Western Australia UWA, Dept Elect & Elect Engn, Crawley, WA 6009, Australia
关键词
Underwater image; Multi-view input; Fusion mechanism; Deep learning;
D O I
10.1016/j.engappai.2023.105946
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Due to wavelength-dependent light absorption and scattering, underwater images often appear with a colour cast and blurry details. Most existing deep learning methods utilize a single input end-to-end network structure, which leads to a single form and content of the extracted features. To address these problems, we present a novel multi-feature underwater image enhancement method via embedded fusion mechanism (MFEF). We find that the quality of reconstruction results is affected by the quality of the input image to some extent, and use pre-processing to obtain high-quality images, which can improve the final reconstruction effect. We introduce the white balance (WB) algorithm and the contrast-limited adaptive histogram equalization (CLAHE) algorithm employing multiple path inputs to extract different forms of rich features in multiple views. To fully interact with features from multiple views, we design a multi-feature fusion (MFF) module to fuse derived image features. We suggest a novel pixel-weighted channel attention module (PCAM) that calibrates the detailed features of the degraded images using a weight matrix to give diverse weights to the encoded features. Ultimately, our network utilizes a fusion mechanism-based encoder and decoder that can be applied to restore various underwater scenes. In the UIEB dataset, our PSNR increased by 10.2% compared to that of Ucolor. Extensive experimental results demonstrate that the MFEF method outperforms other state-of-the-art underwater image enhancement methods in various real-world datasets.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] A Multi-view Fusion Method for Image Retrieval
    Zhang, Yang-ping
    Zhang, Shi-bo
    Yan, Yuan-ting
    2016 9TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2016), 2016, : 379 - 383
  • [2] Multi-view Image Fusion
    Comino Trinidad, Marc
    Martin Brualla, Ricardo
    Kainz, Florian
    Kontkanen, Janne
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 4100 - 4109
  • [3] Underwater image enhancement method via multi-feature prior fusion
    Jingchun Zhou
    Dehuan Zhang
    Weishi Zhang
    Applied Intelligence, 2022, 52 : 16435 - 16457
  • [4] Underwater image enhancement method via multi-feature prior fusion
    Zhou, Jingchun
    Zhang, Dehuan
    Zhang, Weishi
    APPLIED INTELLIGENCE, 2022, 52 (14) : 16435 - 16457
  • [5] A new method for multi-view range image fusion
    Zhang, ZH
    Peng, X
    Shi, WQ
    Hu, XT
    OPTICAL MEASUREMENT AND NONDESTRUCTIVE TESTING: TECHNIQUES AND APPLICATIONS, 2000, 4221 : 115 - 119
  • [6] A Multi-View Fusion Method via Tensor Learning and Gradient Descent for Image Features
    Yu, Laihang
    Zhang, Dongyan
    Liu, Ningzhong
    Zhou, Wengang
    IEEE ACCESS, 2021, 9 : 79389 - 79399
  • [7] CFNet: A medical image segmentation method using the multi-view attention mechanism and adaptive fusion strategy
    Zhan, Bangcheng
    Song, Enmin
    Liu, Hong
    Gong, Zhenyu
    Ma, Guangzhi
    Hung, Chih-Cheng
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 79
  • [8] Underwater image enhancement via color correction and multi-feature image fusion
    Ke, Ke
    Zhang, Biyun
    Zhang, Chunmin
    Yao, Baoli
    Guo, Shiping
    Tang, Feng
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (09)
  • [9] Multi-View Image Clustering via Representations Fusion Method With Semi-Nonnegative Matrix Factorization
    Li, Guopeng
    Han, Kun
    Pan, Zhisong
    Wang, Shuaihui
    Song, Dan
    IEEE ACCESS, 2021, 9 : 96233 - 96243
  • [10] Image super-resolution via multi-view information fusion networks
    Jiang, Xinrui
    Wang, Nannan
    Xin, Jingwei
    Yang, Xi
    Yu, Yi
    Gao, Xinbo
    NEUROCOMPUTING, 2020, 402 : 29 - 37