Underwater Image Enhancement Using Deep Transfer Learning Based on a Color Restoration Model

被引:19
|
作者
Zhang, Yunfeng [1 ]
Jiang, Qun [1 ]
Liu, Peide [2 ]
Gao, Shanshan [1 ]
Pan, Xiao [1 ,3 ]
Zhang, Caiming [4 ]
机构
[1] Shandong Univ Finance & Econ, Sch Comp Sci & Technol, Jinan 250014, Peoples R China
[2] Shandong Univ Finance & Econ, Inst Marine Econ & Management, Sch Management Sci & Engn, Jinan 250014, Peoples R China
[3] Shandong Univ Finance & Econ, Shandong Res Ctr, China US Digital Media Int Cooperat, Jinan 250014, Peoples R China
[4] Shandong Univ, Sch Comp Sci & Technol, Jinan 250100, Peoples R China
关键词
Image color analysis; Image restoration; Image enhancement; Degradation; Cameras; Adaptation models; Attenuation; Coarse granularity similarity; physical model; transfer learning; underwater image enhancement;
D O I
10.1109/JOE.2022.3227393
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
In ocean engineering, an underwater vehicle is widely used as an important equipment to explore the ocean. However, due to the reflection and attenuation of light when propagating in water, the images captured by the visual system of an underwater vehicle in the complex underwater environment usually suffer from low visibility, blurred details, and color distortion. To solve this problem, in this article, we present an underwater image enhancement framework based on transfer learning, which consists of a domain transformation module and an image enhancement module. The two modules, respectively, perform color correction and image enhancement, effectively transferring in-air image dehazing to underwater image enhancement. To maintain the physical properties of an underwater image, we embed the physical model into the domain transformation module which ensures that the transformed image complies with the physical model. To effectively remove the color deviation, a coarse-grained similarity calculation is added to the domain transformation module to improve the model performance. The experimental results on real-world underwater images of different scenes show that the presented method is superior to some advanced underwater image enhancement algorithms both qualitatively and quantitatively. Furthermore, we conduct ablation experiments to indicate the contribution of each component and further validate the effectiveness of the presented method through application tests.
引用
收藏
页码:489 / 514
页数:26
相关论文
共 50 条
  • [31] Integrating deep learning and traditional image enhancement techniques for underwater image enhancement
    Shi, Zhenghao
    Wang, Yongli
    Zhou, Zhaorun
    Ren, Wenqi
    IET IMAGE PROCESSING, 2022, 16 (13) : 3471 - 3484
  • [32] Adaptive Underwater Image Enhancement via Color Channel Compensation Based on Optical Restoration and Fusion
    Wang, Xiaojie
    Li, Fei
    Zhou, Shujie
    Du, Hong
    IMAGE AND GRAPHICS (ICIG 2021), PT III, 2021, 12890 : 207 - 217
  • [33] Underwater image enhancement and restoration based on local fusion
    Gao, Yakun
    Wang, Jing
    Li, Haibin
    Feng, Lei
    JOURNAL OF ELECTRONIC IMAGING, 2019, 28 (04)
  • [34] Augmenting efficacy of polarization-based underwater image restoration through enhancement and color calibration
    Xia, Zhengde
    Zhang, Xinyu
    Li, Shuo
    Liu, Bin
    Pan, Jinxiao
    Song, Na
    Chen, Ping
    OPTICS EXPRESS, 2024, 32 (26): : 46180 - 46202
  • [35] Underwater Image Restoration Based on An Improved Underwater Image Formation Model
    Fan, XinNan
    Zhou, Xuan
    Shi, PengFei
    Sun, HuanRu
    Ye, ShuYue
    2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 95 - 99
  • [36] Underwater Image Restoration Based on A New Underwater Image Formation Model
    Zhang, Mohua
    Peng, Jianhua
    IEEE ACCESS, 2018, 6 : 58634 - 58644
  • [37] Image Enhancement Approach for the Underwater Images Using the Optimized Color Balancing Model
    Lyernisha, S. R.
    Christopher, C. Seldev
    Fernisha, S. R.
    INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2023, 32 (08)
  • [38] A Deep Learning-Based Underwater Image Enhancement Scheme for Turbid Underwater Aquaculture Environments
    Hu, Wu-Chih
    Chen, Liang-Bi
    Yu, Po-Ju
    Wu, Ming-Yuan
    Chen, Kai-Hung
    Huang, Xiang-Rui
    2024 6TH INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATION AND THE INTERNET, ICCCI 2024, 2024, : 107 - 112
  • [39] Underwater image enhancement based on color-line model and homomorphic filtering
    Yu, Haifeng
    Li, Xinbin
    Lou, Qian
    Yan, Lei
    SIGNAL IMAGE AND VIDEO PROCESSING, 2022, 16 (01) : 83 - 91
  • [40] Underwater image enhancement algorithm based on improved color-line model
    Liang, Xiuman
    Yao, Xinzhe
    Liu, Zhendong
    Yu, Haifeng
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2024, 39 (10)