Zero-UMSIE: a zero-shot underwater multi-scale image enhancement method based on isomorphic features

被引:1
|
作者
Liu, Tong [1 ]
Zhu, Kaiyan [2 ]
Cao, Weiye [2 ]
Shan, Bolin [1 ]
Guo, Fangyi [1 ]
机构
[1] Dalian Ocean Univ, Sch Mech & Power Engn, Dalian, Peoples R China
[2] Dalian Ocean Univ, Sch Informat Engn, Dalian, Peoples R China
来源
OPTICS EXPRESS | 2024年 / 32卷 / 23期
关键词
RESTORATION;
D O I
10.1364/OE.538120
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Due to the scattering and absorption of light, underwater images often exhibit degradation. Given the scarcity of paired real-world data and the inability of synthetic paired data to perfectly approximate real-world data, it's a challenge to restore these degraded images using deep neural networks. In this paper, a zero-shot underwater multi-scale image enhancement method (Zero-UMSIE) is proposed, which utilizes the isomorphism between the original underwater image and the re-degraded image. Specifically, Zero-UMSIE first estimates three latent components of the original underwater image: the global background light, the transmission map, and the scene radiance. Then, the estimated scene radiance is randomly mixed with the original underwater image to generate re-degraded images. Finally, a multi-scale loss and a set of tailored non-reference loss functions are employed to fine-tune the underwater image and enhance the generalization ability of the network. These functions implicitly control the learning preferences of the network and effectively address issues such as color bias and uneven illumination in underwater images, without the need for additional datasets. The proposed method is evaluated on three widely used real-world underwater image datasets. Extensive experiments on various benchmarks demonstrate that the proposed method is superior to state-of-the-art methods subjectively and objectively, which is competitive and applicable to diverse underwater conditions. (c) 2024 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement
引用
收藏
页码:40398 / 40415
页数:18
相关论文
共 50 条
  • [1] Underwater image enhancement based on zero-shot learning and level adjustment
    Xie, Qiang
    Gao, Xiujing
    Liu, Zhen
    Huang, Hongwu
    HELIYON, 2023, 9 (04)
  • [2] Multi-Scale Speaker Vectors for Zero-Shot Speech Synthesis
    Cory, Tristin
    Iqbal, Razib
    2022 IEEE 46TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE (COMPSAC 2022), 2022, : 496 - 501
  • [3] A Zero-Shot Image Enhancement Method Based on Human Skin Tone Reference
    Oliveira, Diulhio
    Lopes, Alexandre
    Luquezi, Vitor Galassi
    Nogueira, Carlos Eduardo
    Schiezaro, Mauricio
    Liu, Dennis
    Pedrini, Helio
    2023 36TH CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES, SIBGRAPI 2023, 2023, : 187 - 192
  • [4] Multi-scale visual attention for attribute disambiguation in zero-shot learning
    Tian, Long
    Chen, Bo
    Ren, Jie
    Zhang, Hao
    Wu, Zhenhua
    Han, Ning
    Chen, Yuanwei
    Liu, Hongwei
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2022, 103
  • [5] ADAPTIVE MULTI-SCALE SEMANTIC FUSION NETWORK FOR ZERO-SHOT LEARNING
    Song, Jing
    Peng, Peixi
    Zhai, Yunpeng
    Zhang, Chong
    Tian, Yonghong
    2021 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2021,
  • [6] Method for improving zero-shot image classification
    Chen, Xiangfeng
    Chen, Wenbai
    Zhang, Chong
    Lv, Mengyao
    Han, Hu
    JOURNAL OF ENGINEERING-JOE, 2018, (16): : 1688 - 1691
  • [7] Zero-Shot Image Classification Method Based on Attribute Weighting
    Chen, Wenbai
    Chen, Xiangfeng
    Liu, Chang
    Wu, Hao
    Li, Denghua
    PROCEEDINGS OF 2019 6TH IEEE INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND INTELLIGENCE SYSTEMS (CCIS), 2019, : 84 - 88
  • [8] Exploiting multi-scale contextual prompt learning for zero-shot semantic segmentation☆
    Wang, Yiqi
    Tian, Yingjie
    DISPLAYS, 2024, 81
  • [9] Zero-Shot Image Classification Based on Attribute
    Zhang, Wei
    Chen, Wenbai
    Chen, Xiangfeng
    Han, Hu
    2017 INTERNATIONAL CONFERENCE ON SECURITY, PATTERN ANALYSIS, AND CYBERNETICS (SPAC), 2017, : 25 - 30
  • [10] A Zero-Shot Low Light Image Enhancement Method Integrating Gating Mechanism
    Tian, Junhao
    Zhang, Jianwei
    SENSORS, 2023, 23 (16)