Task-Friendly Underwater Image Enhancement for Machine Vision Applications

被引:2
|
作者
Yu, Meng [1 ]
Shen, Liquan [2 ]
Wang, Zhengyong [1 ]
Hua, Xia [2 ]
机构
[1] Shanghai Univ, Sch Commun & Informat Engn, Shanghai 200444, Peoples R China
[2] Shanghai Univ, Key Lab Specialty Fiber Opt & Opt Access Networks, Joint Int Res Lab Specialty Fiber Opt & Adv Commun, Shanghai 200444, Peoples R China
基金
中国国家自然科学基金;
关键词
Contrastive learning; disentangled representation (DR); machine vision tasks; underwater image enhancement (UIE);
D O I
10.1109/TGRS.2023.3340244
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Underwater images are often affected by color cast and blurring, which degrade the performance of underwater machine vision tasks. While existing underwater image enhancement (UIE) methods have been proposed to improve image quality for human perception, their effectiveness in enhancing machine vision performance is limited. In this article, a novel unsupervised UIE framework based on disentangled representation (DR) is proposed, which is designed for machine vision tasks. Specifically, the proposed framework disentangles the underwater image into two parts in the latent space according to whether they are beneficial to machine vision tasks: the task-friendly content features and the task-unfriendly distortion features. In addition, a semantic-aware contrastive module (SACM) is employed to alleviate the impact of losing key information required for machine vision tasks using the strategy of contrastive learning. Furthermore, two branches on the features and images are incorporated into the enhancement network, which serve the purpose of delivering task-relevant information to the enhancement model and guide the network to generate task-friendly images. Evaluation of the proposed method is conducted on multiple underwater image datasets, and a comparison is made with state-of-the-art enhancement methods in terms of machine vision performance. The experimental results demonstrate that the proposed method surpasses existing approaches in improving the accuracy and robustness of machine vision tasks, including object detection, semantic segmentation, and saliency detection in underwater environments. Our code is available at https://github.com/gemyumeng/TFUIE.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 50 条
  • [31] Underwater image enhancement: a comprehensive review, recent trends, challenges and applications
    Raveendran, Smitha
    Patil, Mukesh D.
    Birajdar, Gajanan K.
    ARTIFICIAL INTELLIGENCE REVIEW, 2021, 54 (07) : 5413 - 5467
  • [32] Underwater Image Enhancement by Fusion
    Zhang, Can
    Zhang, Xu
    Tu, Dawei
    ADVANCED MANUFACTURING AND AUTOMATION VII, 2018, 451 : 81 - 92
  • [33] Underwater LiDAR Image Enhancement Using a GAN Based Machine Learning Technique
    Estrada, Dennis C.
    Dalgleish, Fraser R.
    Den Ouden, Casey J.
    Ramos, Brian
    Li, Yanjun
    Ouyang, Bing
    IEEE SENSORS JOURNAL, 2022, 22 (05) : 4438 - 4451
  • [34] Underwater image enhancement with image colorfulness measure
    Yang, Xi
    Li, Hui
    Chen, Rong
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2021, 95
  • [35] Underwater image enhancement with image colorfulness measure
    Yang, Xi
    Li, Hui
    Chen, Rong
    Signal Processing: Image Communication, 2021, 95
  • [36] Underwater Image Enhancement Using Image Processing
    Nagamma, V.
    Halse, S. V.
    THIRD INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND CAPSULE NETWORKS (ICIPCN 2022), 2022, 514 : 13 - 22
  • [37] Attention-model Guided Image Enhancement for Robotic Vision Applications
    Yi, Ming
    Li, Wanxiang
    Elibol, Armagan
    Chong, Nak-Young
    2020 17TH INTERNATIONAL CONFERENCE ON UBIQUITOUS ROBOTS (UR), 2020, : 514 - 519
  • [38] Machine Vision and Applications
    Yong Wang
    Hui Guo
    FRONTIERS OF MECHANICAL ENGINEERING AND MATERIALS ENGINEERING II, PTS 1 AND 2, 2014, 457-458 : 1377 - 1380
  • [39] Multivariate analysis-based image enhancement model for machine vision inspection
    Wang, Chien-Chih
    Jiang, Bernard C.
    Chou, Yueh-Shia
    Chu, Chien-Cheng
    INTERNATIONAL JOURNAL OF PRODUCTION RESEARCH, 2011, 49 (10) : 2999 - 3021
  • [40] Applications of direct 3D motion estimation for underwater machine vision systems
    Negahdaripour, S
    Xu, X
    Khamene, A
    OCEANS'98 - CONFERENCE PROCEEDINGS, VOLS 1-3, 1998, : 51 - 55