Underwater Image Enhancement Using Deep Transfer Learning Based on a Color Restoration Model

被引:19
|
作者
Zhang, Yunfeng [1 ]
Jiang, Qun [1 ]
Liu, Peide [2 ]
Gao, Shanshan [1 ]
Pan, Xiao [1 ,3 ]
Zhang, Caiming [4 ]
机构
[1] Shandong Univ Finance & Econ, Sch Comp Sci & Technol, Jinan 250014, Peoples R China
[2] Shandong Univ Finance & Econ, Inst Marine Econ & Management, Sch Management Sci & Engn, Jinan 250014, Peoples R China
[3] Shandong Univ Finance & Econ, Shandong Res Ctr, China US Digital Media Int Cooperat, Jinan 250014, Peoples R China
[4] Shandong Univ, Sch Comp Sci & Technol, Jinan 250100, Peoples R China
关键词
Image color analysis; Image restoration; Image enhancement; Degradation; Cameras; Adaptation models; Attenuation; Coarse granularity similarity; physical model; transfer learning; underwater image enhancement;
D O I
10.1109/JOE.2022.3227393
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
In ocean engineering, an underwater vehicle is widely used as an important equipment to explore the ocean. However, due to the reflection and attenuation of light when propagating in water, the images captured by the visual system of an underwater vehicle in the complex underwater environment usually suffer from low visibility, blurred details, and color distortion. To solve this problem, in this article, we present an underwater image enhancement framework based on transfer learning, which consists of a domain transformation module and an image enhancement module. The two modules, respectively, perform color correction and image enhancement, effectively transferring in-air image dehazing to underwater image enhancement. To maintain the physical properties of an underwater image, we embed the physical model into the domain transformation module which ensures that the transformed image complies with the physical model. To effectively remove the color deviation, a coarse-grained similarity calculation is added to the domain transformation module to improve the model performance. The experimental results on real-world underwater images of different scenes show that the presented method is superior to some advanced underwater image enhancement algorithms both qualitatively and quantitatively. Furthermore, we conduct ablation experiments to indicate the contribution of each component and further validate the effectiveness of the presented method through application tests.
引用
收藏
页码:489 / 514
页数:26
相关论文
共 50 条
  • [41] Underwater image enhancement based on color-line model and homomorphic filtering
    Haifeng Yu
    Xinbin Li
    Qian Lou
    Lei Yan
    Signal, Image and Video Processing, 2022, 16 : 83 - 91
  • [42] Deep pixel-to-pixel network for underwater image enhancement and restoration
    Sun, Xin
    Liu, Lipeng
    Li, Qiong
    Dong, Junyu
    Lima, Estanislau
    Yin, Ruiying
    IET IMAGE PROCESSING, 2019, 13 (03) : 469 - 474
  • [43] Underwater Color Image Enhancement Using Combining Schemes
    Luan, Xin
    Hou, Guojia
    Sun, Zhengyuan
    Wang, Yongfang
    Song, Dalei
    Wang, Shuxin
    MARINE TECHNOLOGY SOCIETY JOURNAL, 2014, 48 (03) : 57 - 62
  • [44] AquaAE: A Lightweight Deep Learning Network for Underwater Image Restoration
    Yang, Chun
    Xie, Haijun
    Wang, Jiahang
    Liang, Haohua
    Zhang, Yuting
    Deng, Yi
    2024 4TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND INTELLIGENT SYSTEMS ENGINEERING, MLISE 2024, 2024, : 138 - 144
  • [45] Underwater Image Enhancement based on Dehazing and Color Correction
    Li, Hanyu
    Zhuang, Peixian
    Wang, Wei
    Li, Jingjing
    2019 IEEE INTL CONF ON PARALLEL & DISTRIBUTED PROCESSING WITH APPLICATIONS, BIG DATA & CLOUD COMPUTING, SUSTAINABLE COMPUTING & COMMUNICATIONS, SOCIAL COMPUTING & NETWORKING (ISPA/BDCLOUD/SOCIALCOM/SUSTAINCOM 2019), 2019, : 1365 - 1370
  • [46] Underwater Image Enhancement Based on Color Feature Fusion
    Gong, Tianyu
    Zhang, Mengmeng
    Zhou, Yang
    Bai, Huihui
    ELECTRONICS, 2023, 12 (24)
  • [47] Underwater Image Restoration via Adaptive Color Correction and Contrast Enhancement Fusion
    Zhang, Weihong
    Li, Xiaobo
    Xu, Shuping
    Li, Xujin
    Yang, Yiguang
    Xu, Degang
    Liu, Tiegen
    Hu, Haofeng
    REMOTE SENSING, 2023, 15 (19)
  • [48] Underwater Image Restoration using Single Color Channel Prior
    Borkar, Samarth
    Bonde, S. V.
    2016 INTERNATIONAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (ICONSIP), 2016,
  • [49] Scattering model based underwater image restoration
    Bian X.
    Wang X.
    Jiqiren/Robot, 2010, 32 (06): : 721 - 725
  • [50] Model based image restoration for underwater images
    Stephan, Thomas
    Fruehberger, Peter
    Werling, Stefan
    Heizmann, Michael
    VIDEOMETRICS, RANGE IMAGING, AND APPLICATIONS XII; AND AUTOMATED VISUAL INSPECTION, 2013, 8791