Meta underwater camera: A smart protocol for underwater image enhancement

被引:31
|
作者
Wang, Hao [1 ]
Sun, Shixin [2 ]
Ren, Peng [2 ]
机构
[1] China Univ Petr East China, Coll Control Sci & Engn, Qingdao 266580, Peoples R China
[2] China Univ Petr East China, Coll Oceanog & Space Informat, Qingdao 266580, Peoples R China
关键词
Meta underwater camera; Underwater image enhancement; Smart protocol; Reinforcement learning; CONTRAST ENHANCEMENT; STRUCTURED LIGHT; QUALITY; NETWORK; MODEL; WATER;
D O I
10.1016/j.isprsjprs.2022.12.007
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
Underwater images captured by an underwater camera normally suffer from visual degradation issues, such as color deviations, low contrasts, and detail blurs. Existing studies tend to address these issues separately by individual techniques, such that underwater image visibility can hardly be improved in an overall, consistent manner. To address this limitation, we present a smart protocol for underwater image enhancement. The protocol comprises a comprehensive cascade of seven image enhancement techniques, i.e., attenuated channel compensation, white balance, tone mapping, hue-saturation-lightness (HSL) model-based saturation adjustment, contrast stretching, gamma correction, and high-pass fusion. The protocol is smartly configured by reinforcement learning. Specifically, a set of underwater image multi-color space features are considered as a state, a set of parameter values for the protocol as an action, and an increment of a non-reference visual preference score as a reward. By the reinforcement learning strategy, the parameter values for the seven techniques in the protocol are optimally configured as a whole, resulting in optimal underwater image enhancement results. We refer to the functionality of the smart protocol as a meta underwater camera (MUC) methodology because it operates behind an underwater camera's operation of capturing underwater images but provides underwater images of high visibility beyond those of low visibility originally obtained from the underwater camera. Qualitative and quantitative empirical results validate that our MUC methodology outperforms state-of-the-art underwater image enhancement methods. We release the reproducible code at https://gitee.com/wanghaoupc/MUC_UnderwaterImageEnhancement for public evaluations.
引用
收藏
页码:462 / 481
页数:20
相关论文
共 50 条
  • [1] Underwater Image Enhancement by Fusion
    Zhang, Can
    Zhang, Xu
    Tu, Dawei
    ADVANCED MANUFACTURING AND AUTOMATION VII, 2018, 451 : 81 - 92
  • [2] Image Enhancement for Underwater Applications
    Stephan, Thomas
    Heizmann, Michael
    TM-TECHNISCHES MESSEN, 2013, 80 (10) : 312 - 319
  • [3] Image enhancement for underwater applications
    Bildverbesserung in Unterwasser-Anwendungen
    Stephan, T. (thomas.stephan@iosb.fraunhofer.de), 1600, Walter de Gruyter GmbH (80):
  • [4] Light field camera image sharpness enhancement for underwater machine vision application
    Yong, Ji
    Tu Da-wei
    Xu, Zhang
    Yun, Jin
    Chen, Li
    2019 2ND WORLD CONFERENCE ON MECHANICAL ENGINEERING AND INTELLIGENT MANUFACTURING (WCMEIM 2019), 2019, : 499 - 503
  • [5] Underwater image enhancement with image colorfulness measure
    Yang, Xi
    Li, Hui
    Chen, Rong
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2021, 95
  • [6] Underwater image enhancement with image colorfulness measure
    Yang, Xi
    Li, Hui
    Chen, Rong
    Signal Processing: Image Communication, 2021, 95
  • [7] Underwater Image Enhancement Using Image Processing
    Nagamma, V.
    Halse, S. V.
    THIRD INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND CAPSULE NETWORKS (ICIPCN 2022), 2022, 514 : 13 - 22
  • [8] Underwater Image Enhancement With Reinforcement Learning
    Sun, Shixin
    Wang, Hao
    Zhang, Hao
    Li, Mingjie
    Xiang, Ming
    Luo, Cai
    Ren, Peng
    IEEE JOURNAL OF OCEANIC ENGINEERING, 2024, 49 (01) : 249 - 261
  • [9] Domain Adaptation for Underwater Image Enhancement
    Wang, Zhengyong
    Shen, Liquan
    Xu, Mai
    Yu, Mei
    Wang, Kun
    Lin, Yufei
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 1442 - 1457
  • [10] Effective solution for underwater image enhancement
    Tao, Ye
    Dong, Lili
    Xu, Luqiang
    Xu, Wenhai
    OPTICS EXPRESS, 2021, 29 (20) : 32412 - 32438