Wavelength-based Attributed Deep Neural Network for Underwater Image Restoration

被引:61
|
作者
Sharma, Prasen [1 ]
Bisht, Ira [1 ]
Sur, Arijit [1 ]
机构
[1] Indian Inst Technol Guwahati, Dept Comp Sci & Engn, Multimedia Lab, Gauhati, Assam, India
关键词
Image restoration; underwater vision; enhancement; super-resolution; deep learning; ENHANCEMENT;
D O I
10.1145/3511021
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Background: Underwater images, in general, suffer from low contrast and high color distortions due to the non-uniform attenuation of the light as it propagates through the water. In addition, the degree of attenuation varies with the wavelength, resulting in the asymmetric traversing of colors. Despite the prolific works for underwater image restoration (UIR) using deep learning, the above asymmetricity has not been addressed in the respective network engineering. Contributions: As the first novelty, this article shows that attributing the right receptive field size (context) based on the traversing range of the color channel may lead to a substantial performance gain for the task of UIR. Further, it is important to suppress the irrelevant multi-contextual features and increase the representational power of the model. Therefore, as a second novelty, we have incorporated an attentive skip mechanism to adaptively refine the learned multi-contextual features. The proposed framework, called Deep WaveNet, is optimized using the traditional pixel-wise and feature-based cost functions. An extensive set of experiments have been carried out to show the efficacy of the proposed scheme over existing best-published literature on benchmark datasets. More importantly, we have demonstrated a comprehensive validation of enhanced images across various high-level vision tasks, e.g., underwater image semantic segmentation and diver's 2D pose estimation. A sample video to exhibit our real-world performance is available at https://tinyurl.com/yzcrup9n. Also, we have open-sourced our framework at https://github.com/pksvision/Deep-WaveNet-UnderwaterImage- Restoration.
引用
收藏
页数:23
相关论文
共 50 条
  • [21] Fog Image Restoration based on Neural Network Algorithm
    Wang, Shanyue
    Liu, Dong
    Zhao, Xin
    2011 INTERNATIONAL CONFERENCE ON COMPUTER APPLICATION AND EDUCATION TECHNOLOGY (ICCAET 2011), 2011, : 257 - 260
  • [22] Morphological neural network based on QGA for image restoration
    Ye, Zhengchun
    He, Chunmei
    ADVANCES IN MECHATRONICS AND CONTROL ENGINEERING, PTS 1-3, 2013, 278-280 : 1388 - +
  • [23] Restoration of Underwater Distorted Image Sequence Based on Generative Adversarial Network
    He, Changxin
    Zhang, Zhen
    PROCEEDINGS OF 2019 IEEE 8TH JOINT INTERNATIONAL INFORMATION TECHNOLOGY AND ARTIFICIAL INTELLIGENCE CONFERENCE (ITAIC 2019), 2019, : 866 - 870
  • [24] Underwater image restoration based on perceptually optimized generative adversarial network
    Wang, Peng
    Chen, Haixiu
    Xu, Weihua
    Jin, Suqin
    JOURNAL OF ELECTRONIC IMAGING, 2020, 29 (03)
  • [25] Underwater image restoration using deep encoder–decoder network with symmetric skip connections
    Shankar Gangisetty
    Raghu Raj Rai
    Signal, Image and Video Processing, 2022, 16 : 247 - 255
  • [26] An Underwater Image Restoration Deep Learning Network Combining Attention Mechanism and Brightness Adjustment
    Zheng, Jianhua
    Zhao, Ruolin
    Yang, Gaolin
    Liu, Shuangyin
    Zhang, Zihao
    Fu, Yusha
    Lu, Junde
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2024, 12 (01)
  • [27] Deep neural network based image annotation
    Zhu, Songhao
    Shi, Zhe
    Sun, Chengjian
    Shen, Shuhan
    PATTERN RECOGNITION LETTERS, 2015, 65 : 103 - 108
  • [28] Deep neural network-based underwater OFDM receiver
    Zhang, Jing
    Cao, Yu
    Han, Guangyao
    Fu, Xiaomei
    IET COMMUNICATIONS, 2019, 13 (13) : 1998 - 2002
  • [29] Underwater Image Restoration Based on An Improved Underwater Image Formation Model
    Fan, XinNan
    Zhou, Xuan
    Shi, PengFei
    Sun, HuanRu
    Ye, ShuYue
    2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 95 - 99
  • [30] Underwater Image Restoration Based on A New Underwater Image Formation Model
    Zhang, Mohua
    Peng, Jianhua
    IEEE ACCESS, 2018, 6 : 58634 - 58644