UnitModule: A lightweight joint image enhancement module for underwater object detection

被引:3
|
作者
Liu, Zhuoyan [1 ]
Wang, Bo [1 ]
Li, Ye [1 ]
He, Jiaxian [1 ]
Li, Yunfeng [1 ]
机构
[1] Harbin Engn Univ, Natl Key Lab Autonomous Marine Vehicle Technol, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Underwater object detection; Image enhancement; Unsupervised learning; Joint training;
D O I
10.1016/j.patcog.2024.110435
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Underwater object detection faces the problem of underwater image degradation, which affects the performance of the detector. Underwater object detection methods based on noise reduction and image enhancement usually do not provide images preferred by the detector or require additional datasets. In this paper, we propose a plug-and-play U nderwater joint n t i mage enhancement t Module (UnitModule) that provides the input image preferred by the detector. We design an unsupervised learning loss for the joint training of UnitModule with the detector without additional datasets to improve the interaction between UnitModule and the detector. Furthermore, a color cast predictor with the assisting color cast loss and a data augmentation called Underwater Color Random Transfer (UCRT) are designed to improve the performance of UnitModule on underwater images with different color casts. Extensive experiments are conducted on DUO for different object detection models, where UnitModule achieves the highest performance improvement of 2.6 AP for YOLOv5-S and gains the improvement of 3.3 AP on the brand-new test set (URPCtest). t est ). And UnitModule significantly improves the performance of all object detection models we test, especially for models with a small number of parameters. In addition, UnitModule with a small number of parameters of 31K has little effect on the inference speed of the original object detection model. Our quantitative and visual analysis also demonstrates the effectiveness of UnitModule in enhancing the input image and improving the perception ability of the detector for object features. The code is available at https://github.com/LEFTeyex/UnitModule.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Joint Iterative Color Correction and Dehazing for Underwater Image Enhancement
    Wang, Kun
    Shen, Liquan
    Lin, Yufei
    Li, Mengyao
    Zhao, Qijie
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (03) : 5121 - 5128
  • [42] Object Detection of Underwater Fish at Night Based on Improved Cascade R-CNN and Image Enhancement
    Zhang M.
    Long T.
    Song W.
    Huang D.
    Mei H.
    He Q.
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2021, 52 (09): : 179 - 185
  • [43] Underwater Image Enhancement by Joint Lab and Opponent Color Spaces
    Huang, Xing
    Sun, Yujuan
    Zhang, Xiaofeng
    Zhang, Jiaxing
    2023 INTERNATIONAL CONFERENCE ON DATA SECURITY AND PRIVACY PROTECTION, DSPP, 2023, : 243 - 247
  • [44] Object Detection in Infrared Images Using Modified YOLOv4 Models and an Image Enhancement Module
    Wang, Dan
    Du, Huiqian
    Ma, Zhifeng
    FOURTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING, ICGIP 2022, 2022, 12705
  • [45] Enhancement of Physical Modeling System for Underwater Moving Object Detection
    Kim, Yesol
    Lee, Hyosun
    Cho, Sung-Ho
    Jung, Hyun-Key
    GEOPHYSICS AND GEOPHYSICAL EXPLORATION, 2019, 22 (02): : 72 - 79
  • [46] Image Enhancement of Underwater Target Detection by Inhomogeneous Illumination
    Zheng, Haiyong
    Zheng, Bing
    Ji, Guangrong
    Guo, Zhongwen
    Sun, Yuting
    OCEANS, 2012 - YEOSU, 2012,
  • [47] Underwater Moving Target Detection Based on Image Enhancement
    Zhou, Yan
    Li, Qingwu
    Huo, Guanying
    ADVANCES IN NEURAL NETWORKS, PT II, 2017, 10262 : 427 - 436
  • [48] LPS-Net: Lightweight Parallel Strategy Network for Underwater Image Enhancement
    Jiang, Jingxia
    Huang, Peiyun
    Tong, Lihan
    Yin, Junjie
    Chen, Erkang
    APPLIED SCIENCES-BASEL, 2023, 13 (16):
  • [49] LiteEnhanceNet: A lightweight network for real-time single underwater image enhancement
    Zhang, Song
    Zhao, Shili
    An, Dong
    Li, Daoliang
    Zhao, Ran
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 240
  • [50] Research on Lightweight Remote Sensing Image Object Detection Algorithm
    Ma, Xiaofei
    Wu, Jin
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 2979 - 2984