Harnessing multi-resolution and multi-scale attention for underwater image restoration

被引:0
|
作者
Pramanick, Alik [1 ]
Sur, Arijit [1 ]
Saradhi, V. Vijaya [1 ]
机构
[1] Indian Inst Technol Guwahati, Dept Comp Sci & Engn, Gauhati, India
来源
关键词
Underwater image enhancement; Super-resolution; Multi-scale; Multi-resolution; Channel-specific loss; ENHANCEMENT; SUPERRESOLUTION;
D O I
10.1007/s00371-025-03866-0
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Underwater imagery is often compromised by factors such as color distortion and low contrast, posing challenges for high-level vision tasks. Recent underwater image restoration methods either analyze the input image at full resolution, resulting in spatial richness but contextual weakness, or progressively from high to low resolution, yielding reliable semantic information but reduced spatial accuracy. Here, we propose a lightweight multi-stage network called Lit-Net that focuses on multi-resolution and multi-scale image analysis for restoring underwater images while retaining original resolution during the first stage, refining features in the second, and focusing on reconstruction in the final stage. Our novel encoder block utilizes parallel 1x1\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$1\times 1$$\end{document} convolution layers to capture local information and speed up operations. Further, we incorporate a modified weighted color channel-specific l1\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$l_1$$\end{document} loss (cl1\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$cl_1$$\end{document}) function to recover color and detail information. Extensive experimentations on publicly available datasets suggest our model's superiority over recent state-of-the-art methods, with significant improvement in qualitative and quantitative measures, such as 29.477 dB PSNR (1.92%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$1.92\%$$\end{document} improvement) and 0.851 SSIM (2.87%\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$2.87\%$$\end{document} improvement) on the EUVP dataset. The contributions of Lit-Net offer a more robust approach to underwater image enhancement and super-resolution, which is of considerable importance for underwater autonomous vehicles and surveillance. The code is available at: https://github.com/Alik033/Lit-Net.
引用
收藏
页数:20
相关论文
共 50 条
  • [31] Underwater image restoration with multi-scale shallow feature extraction and detail enhancement network
    Wu, Heng
    Deng, Lei
    Chen, Meiyun
    Luo, Shaojuan
    Zhang, Fanlong
    He, Chunhua
    Zhang, Xianmin
    JOURNAL OF MODERN OPTICS, 2023, 70 (13-15) : 886 - 900
  • [32] Color correction and restoration based on multi-scale recursive network for underwater optical image
    Huang, Yifan
    Liu, Manyu
    Yuan, Fei
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2021, 93
  • [33] Multi-Scale Attention Network for Image Cropping
    Lian, Tianpei
    Xian, Ke
    Pan, Zhiyu
    Hong, Chaoyi
    Cao, Zhiguo
    Zhong, Weicai
    2020 CHINESE AUTOMATION CONGRESS (CAC 2020), 2020, : 2640 - 2645
  • [34] Multi-scale attention network for image inpainting
    Qin, Jia
    Bai, Huihui
    Zhao, Yao
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 204
  • [35] IMAGE SUPER-RESOLUTION USING MULTI-RESOLUTION ATTENTION NETWORK
    Liu, Anqi
    Li, Sumei
    Chang, Yongli
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 1610 - 1614
  • [36] Low Frequency Analysis of Multi-Scale Problems with a Multi-Resolution Clipping Technique
    Bercigli, M.
    Vipiana, F.
    Andriulli, F. P.
    Guidi, R.
    Vecchi, G.
    Bandinelli, M.
    PROCEEDINGS OF THE FOURTH EUROPEAN CONFERENCE ON ANTENNAS AND PROPAGATION, 2010,
  • [37] A Multi-Resolution Multi-Scale Computational Approach for Characterization and Analysis of Nanostructured Surfaces
    Mukherjee, Rajib
    Palazoglu, Ahmet
    Romagnoli, Jose A.
    10TH INTERNATIONAL SYMPOSIUM ON PROCESS SYSTEMS ENGINEERING, 2009, 27 : 1761 - 1766
  • [38] Fast Image Restoration Method Based on the Multi-Resolution Layer
    Hsieh, Ching-Tang
    Chen, Yen-Liang
    Hsu, Chih-Hsu
    JOURNAL OF APPLIED SCIENCE AND ENGINEERING, 2009, 12 (04): : 439 - 448
  • [39] A lightweight multi-scale channel attention network for image super-resolution
    Li, Wenbin
    Li, Juefei
    Li, Jinxin
    Huang, Zhiyong
    Zhou, Dengwen
    NEUROCOMPUTING, 2021, 456 : 327 - 337
  • [40] Attention augmented multi-scale network for single image super-resolution
    Xiong, Chengyi
    Shi, Xiaodi
    Gao, Zhirong
    Wang, Ge
    APPLIED INTELLIGENCE, 2021, 51 (02) : 935 - 951