UnitModule: A lightweight joint image enhancement module for underwater object detection

被引:3
|
作者
Liu, Zhuoyan [1 ]
Wang, Bo [1 ]
Li, Ye [1 ]
He, Jiaxian [1 ]
Li, Yunfeng [1 ]
机构
[1] Harbin Engn Univ, Natl Key Lab Autonomous Marine Vehicle Technol, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Underwater object detection; Image enhancement; Unsupervised learning; Joint training;
D O I
10.1016/j.patcog.2024.110435
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Underwater object detection faces the problem of underwater image degradation, which affects the performance of the detector. Underwater object detection methods based on noise reduction and image enhancement usually do not provide images preferred by the detector or require additional datasets. In this paper, we propose a plug-and-play U nderwater joint n t i mage enhancement t Module (UnitModule) that provides the input image preferred by the detector. We design an unsupervised learning loss for the joint training of UnitModule with the detector without additional datasets to improve the interaction between UnitModule and the detector. Furthermore, a color cast predictor with the assisting color cast loss and a data augmentation called Underwater Color Random Transfer (UCRT) are designed to improve the performance of UnitModule on underwater images with different color casts. Extensive experiments are conducted on DUO for different object detection models, where UnitModule achieves the highest performance improvement of 2.6 AP for YOLOv5-S and gains the improvement of 3.3 AP on the brand-new test set (URPCtest). t est ). And UnitModule significantly improves the performance of all object detection models we test, especially for models with a small number of parameters. In addition, UnitModule with a small number of parameters of 31K has little effect on the inference speed of the original object detection model. Our quantitative and visual analysis also demonstrates the effectiveness of UnitModule in enhancing the input image and improving the perception ability of the detector for object features. The code is available at https://github.com/LEFTeyex/UnitModule.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] An Underwater Organism Image Dataset and a Lightweight Module Designed for Object Detection Networks
    Huang, Jiafeng
    Zhang, Tianjun
    Zhao, Shengjie
    Zhang, Lin
    Zhou, Yicong
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (05)
  • [2] Lightweight underwater object detection based on image enhancement and multi-attention
    Tian, Tian
    Cheng, Jixiang
    Wu, Dan
    Li, Zhidan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (23) : 63075 - 63093
  • [3] A lightweight object detection framework for underwater imagery with joint image restoration and color transformation
    Zhou, Ming
    Li, Bo
    Wang, Jue
    Fu, Kailun
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2023, 35 (09)
  • [4] Shape-Guided Detection: A joint network combining object detection and underwater image enhancement together
    Yang, Chao
    Jiang, Longyu
    Li, Zhicheng
    Wu, Jie
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2024, 182
  • [5] Collaborative Framework for Underwater Object Detection via Joint Image Enhancement and Super-Resolution
    Ji, Xun
    Liu, Guo-Peng
    Cai, Cheng-Tao
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (09)
  • [6] Research on the Correlation between Image Enhancement and Underwater Object Detection
    Zhang, Jiashuo
    Zhu, Linlin
    Xu, Liheng
    Xie, Qian
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 5928 - 5933
  • [7] Lightweight Underwater Object Detection Algorithm for Embedded Deployment Using Higher-Order Information and Image Enhancement
    Liu, Changhong
    Wen, Jiawen
    Huang, Jinshan
    Lin, Weiren
    Wu, Bochun
    Xie, Ning
    Zou, Tao
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2024, 12 (03)
  • [8] Joint polarization detection and degradation mechanisms for underwater image enhancement
    Cheng, Cai
    Fu, Qiang
    Bao, Fu-cheng
    Gu, Xian-song
    Hao, You-fei
    Zhu, Yong
    Zhang, Jing-hao
    Liu, Yi
    Tai, Yang
    Wang, Long-xiao
    APPLIED OPTICS, 2023, 62 (24) : 6389 - 6400
  • [9] Underwater Image Enhancement With Lightweight Cascaded Network
    Jiang, Nanfeng
    Chen, Weiling
    Lin, Yuting
    Zhao, Tiesong
    Lin, Chia-Wen
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 4301 - 4313
  • [10] SwiftWater: A lightweight SwiftFormer-based underwater image enhancement network with auxiliary prompt module
    Zhao, Zhongyou
    Guo, Peiwen
    Chen, Xianhao
    Zhang, Qin
    DIGITAL SIGNAL PROCESSING, 2024, 155