UnitModule: A lightweight joint image enhancement module for underwater object detection

被引:3
|
作者
Liu, Zhuoyan [1 ]
Wang, Bo [1 ]
Li, Ye [1 ]
He, Jiaxian [1 ]
Li, Yunfeng [1 ]
机构
[1] Harbin Engn Univ, Natl Key Lab Autonomous Marine Vehicle Technol, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Underwater object detection; Image enhancement; Unsupervised learning; Joint training;
D O I
10.1016/j.patcog.2024.110435
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Underwater object detection faces the problem of underwater image degradation, which affects the performance of the detector. Underwater object detection methods based on noise reduction and image enhancement usually do not provide images preferred by the detector or require additional datasets. In this paper, we propose a plug-and-play U nderwater joint n t i mage enhancement t Module (UnitModule) that provides the input image preferred by the detector. We design an unsupervised learning loss for the joint training of UnitModule with the detector without additional datasets to improve the interaction between UnitModule and the detector. Furthermore, a color cast predictor with the assisting color cast loss and a data augmentation called Underwater Color Random Transfer (UCRT) are designed to improve the performance of UnitModule on underwater images with different color casts. Extensive experiments are conducted on DUO for different object detection models, where UnitModule achieves the highest performance improvement of 2.6 AP for YOLOv5-S and gains the improvement of 3.3 AP on the brand-new test set (URPCtest). t est ). And UnitModule significantly improves the performance of all object detection models we test, especially for models with a small number of parameters. In addition, UnitModule with a small number of parameters of 31K has little effect on the inference speed of the original object detection model. Our quantitative and visual analysis also demonstrates the effectiveness of UnitModule in enhancing the input image and improving the perception ability of the detector for object features. The code is available at https://github.com/LEFTeyex/UnitModule.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Comprehensive Underwater Object Tracking Benchmark Dataset and Underwater Image Enhancement With GAN
    Panetta, Karen
    Kezebou, Landry
    Oludare, Victor
    Agaian, Sos
    IEEE JOURNAL OF OCEANIC ENGINEERING, 2022, 47 (01) : 59 - 75
  • [32] Underwater Image Enhancement and Object Detection Using Edge Preserving and Multiscale Contextual Neural Network
    Meenakumari, M.
    Balaji, S.
    Praveen, John Paul A.
    Ramya, S.
    JOURNAL OF MECHANICS OF CONTINUA AND MATHEMATICAL SCIENCES, 2019, : 348 - 359
  • [33] Enhancement and Detection of Objects in Underwater Images using Image Super-resolution and Effective Object Detection Model
    Arun, R. Arumuga
    Umamaheswari, S.
    Nafesha, B.
    Arvindan, V. Makesh
    Kumar, Vengam Udaya
    JOURNAL OF SCIENTIFIC & INDUSTRIAL RESEARCH, 2022, 81 (10): : 1050 - 1060
  • [34] Intelligent Underwater Object Detection and Image Restoration for Autonomous Underwater Vehicles
    Fayaz, Sheezan
    Parah, Shabir A.
    Qureshi, G. J.
    Lloret, Jaime
    Del Ser, Javier
    Muhammad, Khan
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (02) : 1726 - 1735
  • [35] Evaluation of Laser Image Enhancement and Restoration for Underwater Object Recognition
    Adeoluwa, Oladipupo O.
    Moseley, Carson D.
    Kim, Seongsin M.
    Kung, Patrick
    Gurbuz, Sevgi Z.
    IEEE SENSORS JOURNAL, 2023, 23 (21) : 26136 - 26153
  • [36] Boths: Super Lightweight Network-Enabled Underwater Image Enhancement
    Liu, Xu
    Lin, Sen
    Chi, Kaichen
    Tao, Zhiyong
    Zhao, Yang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [37] Boths: Super Lightweight Network-Enabled Underwater Image Enhancement
    Liu, Xu
    Lin, Sen
    Chi, Kaichen
    Tao, Zhiyong
    Zhao, Yang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [38] LAFFNet: A Lightweight Adaptive Feature Fusion Network for Underwater Image Enhancement
    Yang, Hao-Hsiang
    Huang, Kuan-Chih
    Chen, Wei-Ting
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 685 - 692
  • [39] Multitargets Joint Training Lightweight Model for Object Detection of Substation
    Yan, Xingyu
    Jia, Lixin
    Cao, Hui
    Yu, Yajie
    Wang, Tao
    Zhang, Feng
    Guan, Qingshu
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (02) : 2413 - 2424
  • [40] Underwater Image Enhancement Using Guided Joint Bilateral Filter
    Muhammad, Nasir
    Arini
    Fahrianto, Feri
    2018 6TH INTERNATIONAL CONFERENCE ON CYBER AND IT SERVICE MANAGEMENT (CITSM), 2018, : 55 - 60