Task-Friendly Underwater Image Enhancement for Machine Vision Applications

被引:2
|
作者
Yu, Meng [1 ]
Shen, Liquan [2 ]
Wang, Zhengyong [1 ]
Hua, Xia [2 ]
机构
[1] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
[2] Shanghai Univ, Key Lab Specialty Fiber Opt & Opt Access Networks, Joint Int Res Lab Specialty Fiber Opt & Adv Commun, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Contrastive learning; disentangled representation (DR); machine vision tasks; underwater image enhancement (UIE);
D O I
10.1109/TGRS.2023.3340244
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Underwater images are often affected by color cast and blurring, which degrade the performance of underwater machine vision tasks. While existing underwater image enhancement (UIE) methods have been proposed to improve image quality for human perception, their effectiveness in enhancing machine vision performance is limited. In this article, a novel unsupervised UIE framework based on disentangled representation (DR) is proposed, which is designed for machine vision tasks. Specifically, the proposed framework disentangles the underwater image into two parts in the latent space according to whether they are beneficial to machine vision tasks: the task-friendly content features and the task-unfriendly distortion features. In addition, a semantic-aware contrastive module (SACM) is employed to alleviate the impact of losing key information required for machine vision tasks using the strategy of contrastive learning. Furthermore, two branches on the features and images are incorporated into the enhancement network, which serve the purpose of delivering task-relevant information to the enhancement model and guide the network to generate task-friendly images. Evaluation of the proposed method is conducted on multiple underwater image datasets, and a comparison is made with state-of-the-art enhancement methods in terms of machine vision performance. The experimental results demonstrate that the proposed method surpasses existing approaches in improving the accuracy and robustness of machine vision tasks, including object detection, semantic segmentation, and saliency detection in underwater environments. Our code is available at https://github.com/gemyumeng/TFUIE.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [1] Task-Friendly Underwater Image Enhancement for Machine Vision Applications
    Yu, Meng
    Shen, Liquan
    Wang, Zhengyong
    Hua, Xia
    IEEE Transactions on Geoscience and Remote Sensing, 2024, 62 : 1 - 14
  • [2] Deep underwater image compression for enhanced machine vision applications
    Zhang, Hanshu
    Fan, Suzhen
    Zou, Shuo
    Yu, Zhibin
    Zheng, Bing
    FRONTIERS IN MARINE SCIENCE, 2024, 11
  • [3] Image Contrast Enhancement for Outdoor Machine Vision Applications
    Abd Wahab, Mohd Helmy
    Latip, Rohaya
    Zakaria, Nasriah
    Salam, Rosalina Abdul
    2013 INTERNATIONAL CONFERENCE OF SOFT COMPUTING AND PATTERN RECOGNITION (SOCPAR), 2013, : 377 - 383
  • [4] Light field camera image sharpness enhancement for underwater machine vision application
    Yong, Ji
    Tu Da-wei
    Xu, Zhang
    Yun, Jin
    Chen, Li
    2019 2ND WORLD CONFERENCE ON MECHANICAL ENGINEERING AND INTELLIGENT MANUFACTURING (WCMEIM 2019), 2019, : 499 - 503
  • [5] Image Enhancement for Underwater Applications
    Stephan, Thomas
    Heizmann, Michael
    TM-TECHNISCHES MESSEN, 2013, 80 (10) : 312 - 319
  • [6] Image enhancement for underwater applications
    Bildverbesserung in Unterwasser-Anwendungen
    Stephan, T. (thomas.stephan@iosb.fraunhofer.de), 1600, Walter de Gruyter GmbH (80):
  • [7] Vision graph convolutional network for underwater image enhancement
    Xing, Zexuan
    Xu, Haiyong
    Jiang, Gangyi
    Yu, Mei
    Luo, Ting
    Chen, Yeyao
    KNOWLEDGE-BASED SYSTEMS, 2024, 299
  • [8] Underwater image enhancement using lightweight vision transformer
    Daud, Muneeba
    Afzal, Hammad
    Mahmood, Khawir
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (31) : 75603 - 75625
  • [9] Review of Underwater Machine Vision Technology and Its Applications
    Qiao Xi
    Rauschenbach, Thomas
    Li Daoliang
    MARINE TECHNOLOGY SOCIETY JOURNAL, 2017, 51 (01) : 75 - 97
  • [10] Review of underwater machine vision technology and its applications
    Xi Q.
    Rauschenbach T.
    Daoliang L.
    Daoliang, Li (dliangl@cau.edu.cn), 1600, Marine Technology Society Inc. (51): : 75 - 97