Wavelength-based Attributed Deep Neural Network for Underwater Image Restoration

被引:61
|
作者
Sharma, Prasen [1 ]
Bisht, Ira [1 ]
Sur, Arijit [1 ]
机构
[1] Indian Inst Technol Guwahati, Dept Comp Sci & Engn, Multimedia Lab, Gauhati, Assam, India
关键词
Image restoration; underwater vision; enhancement; super-resolution; deep learning; ENHANCEMENT;
D O I
10.1145/3511021
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Background: Underwater images, in general, suffer from low contrast and high color distortions due to the non-uniform attenuation of the light as it propagates through the water. In addition, the degree of attenuation varies with the wavelength, resulting in the asymmetric traversing of colors. Despite the prolific works for underwater image restoration (UIR) using deep learning, the above asymmetricity has not been addressed in the respective network engineering. Contributions: As the first novelty, this article shows that attributing the right receptive field size (context) based on the traversing range of the color channel may lead to a substantial performance gain for the task of UIR. Further, it is important to suppress the irrelevant multi-contextual features and increase the representational power of the model. Therefore, as a second novelty, we have incorporated an attentive skip mechanism to adaptively refine the learned multi-contextual features. The proposed framework, called Deep WaveNet, is optimized using the traditional pixel-wise and feature-based cost functions. An extensive set of experiments have been carried out to show the efficacy of the proposed scheme over existing best-published literature on benchmark datasets. More importantly, we have demonstrated a comprehensive validation of enhanced images across various high-level vision tasks, e.g., underwater image semantic segmentation and diver's 2D pose estimation. A sample video to exhibit our real-world performance is available at https://tinyurl.com/yzcrup9n. Also, we have open-sourced our framework at https://github.com/pksvision/Deep-WaveNet-UnderwaterImage- Restoration.
引用
收藏
页数:23
相关论文
共 50 条
  • [41] A Variational neural network for image restoration based on coupled regularizers
    Yang, Guangyu
    Wei, Weibo
    Pan, Zhenkuan
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (04) : 12379 - 12401
  • [42] RBF neural network based image fusion restoration approach
    Niu, Lihong
    Ni, Guoqiang
    Su, Binghua
    Guangzi Xuebao/Acta Photonica Sinica, 2006, 35 (02): : 316 - 320
  • [43] Blind image restoration based on alternating iteration and neural network
    Qu, Zhiyi
    Wo, Yan
    Ren, Zhihong
    Jisuanji Xuebao/Chinese Journal of Computers, 2000, 23 (04): : 410 - 414
  • [44] Variational PDE based image restoration using neural network
    Wu, Y.-D.
    Sun, Y.
    Zhang, H.-Y.
    Sun, S.-X.
    IET IMAGE PROCESSING, 2007, 1 (01) : 85 - 93
  • [45] RETRACTED: An Old Photo Image Restoration Processing Based on Deep Neural Network Structure (Retracted Article)
    Wang, Ruoyan
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [46] Underwater Imaging Formation Model-Embedded Multiscale Deep Neural Network for Underwater Image Enhancement
    Li, Fucui
    Lu, Difei
    Lu, ChengLang
    Jiang, Qiuping
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022
  • [47] A general purpose image restoration method with deep neural network and active learning
    Lv, Jiameng
    Ning, Runyu
    Song, Yu
    Jia, Peng
    SOFTWARE AND CYBERINFRASTRUCTURE FOR ASTRONOMY VII, 2022, 12189
  • [48] Deep Convolutional Neural Network for Multi-Modal Image Restoration and Fusion
    Deng, Xin
    Dragotti, Pier Luigi
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (10) : 3333 - 3348
  • [49] Deep Memory Connected Neural Network for Optical Remote Sensing Image Restoration
    Xu, Wenjia
    Xu, Guangluan
    Wang, Yang
    Sun, Xian
    Lin, Daoyu
    Wu, Yirong
    REMOTE SENSING, 2018, 10 (12)
  • [50] Effects of incorporating a deep-unfolding framework into a deep neural network: implications for image restoration
    Itasaka, Tatsuki
    Okuda, Masahiro
    PROCEEDINGS OF 2022 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2022, : 649 - 652