Wavelength-based Attributed Deep Neural Network for Underwater Image Restoration

被引:61
|
作者
Sharma, Prasen [1 ]
Bisht, Ira [1 ]
Sur, Arijit [1 ]
机构
[1] Indian Inst Technol Guwahati, Dept Comp Sci & Engn, Multimedia Lab, Gauhati, Assam, India
关键词
Image restoration; underwater vision; enhancement; super-resolution; deep learning; ENHANCEMENT;
D O I
10.1145/3511021
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Background: Underwater images, in general, suffer from low contrast and high color distortions due to the non-uniform attenuation of the light as it propagates through the water. In addition, the degree of attenuation varies with the wavelength, resulting in the asymmetric traversing of colors. Despite the prolific works for underwater image restoration (UIR) using deep learning, the above asymmetricity has not been addressed in the respective network engineering. Contributions: As the first novelty, this article shows that attributing the right receptive field size (context) based on the traversing range of the color channel may lead to a substantial performance gain for the task of UIR. Further, it is important to suppress the irrelevant multi-contextual features and increase the representational power of the model. Therefore, as a second novelty, we have incorporated an attentive skip mechanism to adaptively refine the learned multi-contextual features. The proposed framework, called Deep WaveNet, is optimized using the traditional pixel-wise and feature-based cost functions. An extensive set of experiments have been carried out to show the efficacy of the proposed scheme over existing best-published literature on benchmark datasets. More importantly, we have demonstrated a comprehensive validation of enhanced images across various high-level vision tasks, e.g., underwater image semantic segmentation and diver's 2D pose estimation. A sample video to exhibit our real-world performance is available at https://tinyurl.com/yzcrup9n. Also, we have open-sourced our framework at https://github.com/pksvision/Deep-WaveNet-UnderwaterImage- Restoration.
引用
收藏
页数:23
相关论文
共 50 条
  • [1] Underwater Image Restoration Based on a Parallel Convolutional Neural Network
    Wang, Keyan
    Hu, Yan
    Chen, Jun
    Wu, Xianyun
    Zhao, Xi
    Li, Yunsong
    REMOTE SENSING, 2019, 11 (13)
  • [2] Polarization Information Restoration of Underwater Images Based on Deep Neural Network
    Liu Hedong
    Han Yilin
    Li Xiaobo
    Cheng Zhenzhou
    Liu Tiegen
    Zhai Jingsheng
    Hu Haofeng
    ACTA OPTICA SINICA, 2024, 44 (12)
  • [3] AquaAE: A Lightweight Deep Learning Network for Underwater Image Restoration
    Yang, Chun
    Xie, Haijun
    Wang, Jiahang
    Liang, Haohua
    Zhang, Yuting
    Deng, Yi
    2024 4TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND INTELLIGENT SYSTEMS ENGINEERING, MLISE 2024, 2024, : 138 - 144
  • [4] Deep Learning Based Underwater Image Enhancement Using Deep Convolution Neural Network
    Ray, Sharmita
    Baghel, Amit
    Bhatia, Vimal
    2022 SECOND INTERNATIONAL CONFERENCE ON ADVANCES IN ELECTRICAL, COMPUTING, COMMUNICATION AND SUSTAINABLE TECHNOLOGIES (ICAECT), 2022,
  • [5] Multi-Turbidity Underwater Image Restoration Based on Neural Network and Polarization Imaging
    Gui Xinyuan
    Zhang Ran
    Cheng Haoyuan
    Tian Lianbiao
    Chu Jinkui
    LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (04)
  • [6] A hybrid attention network with convolutional neural network and transformer for underwater image restoration
    Jiao, Zhan
    Wang, Ruizi
    Zhang, Xiangyi
    Fu, Bo
    Thanh, Dang Ngoc Hoang
    PEERJ COMPUTER SCIENCE, 2023, 9
  • [7] A hybrid attention network with convolutional neural network and transformer for underwater image restoration
    Jiao Z.
    Wang R.
    Zhang X.
    Fu B.
    Thanh D.N.H.
    PeerJ Computer Science, 2023, 9
  • [8] Deep pixel-to-pixel network for underwater image enhancement and restoration
    Sun, Xin
    Liu, Lipeng
    Li, Qiong
    Dong, Junyu
    Lima, Estanislau
    Yin, Ruiying
    IET IMAGE PROCESSING, 2019, 13 (03) : 469 - 474
  • [9] Deep Underwater Image Restoration and Beyond
    Dudhane, Akshay
    Hambarde, Praful
    Patil, Prashant
    Murala, Subrahmanyam
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 675 - 679
  • [10] Sonar Image Target Detection for Underwater Communication System Based on Deep Neural Network
    Zou, Lilan
    Liang, Bo
    Cheng, Xu
    Li, Shufa
    Lin, Cong
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2023, 137 (03): : 2641 - 2659