Wavelength-based Attributed Deep Neural Network for Underwater Image Restoration

被引:61
|
作者
Sharma, Prasen [1 ]
Bisht, Ira [1 ]
Sur, Arijit [1 ]
机构
[1] Indian Inst Technol Guwahati, Dept Comp Sci & Engn, Multimedia Lab, Gauhati, Assam, India
关键词
Image restoration; underwater vision; enhancement; super-resolution; deep learning; ENHANCEMENT;
D O I
10.1145/3511021
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Background: Underwater images, in general, suffer from low contrast and high color distortions due to the non-uniform attenuation of the light as it propagates through the water. In addition, the degree of attenuation varies with the wavelength, resulting in the asymmetric traversing of colors. Despite the prolific works for underwater image restoration (UIR) using deep learning, the above asymmetricity has not been addressed in the respective network engineering. Contributions: As the first novelty, this article shows that attributing the right receptive field size (context) based on the traversing range of the color channel may lead to a substantial performance gain for the task of UIR. Further, it is important to suppress the irrelevant multi-contextual features and increase the representational power of the model. Therefore, as a second novelty, we have incorporated an attentive skip mechanism to adaptively refine the learned multi-contextual features. The proposed framework, called Deep WaveNet, is optimized using the traditional pixel-wise and feature-based cost functions. An extensive set of experiments have been carried out to show the efficacy of the proposed scheme over existing best-published literature on benchmark datasets. More importantly, we have demonstrated a comprehensive validation of enhanced images across various high-level vision tasks, e.g., underwater image semantic segmentation and diver's 2D pose estimation. A sample video to exhibit our real-world performance is available at https://tinyurl.com/yzcrup9n. Also, we have open-sourced our framework at https://github.com/pksvision/Deep-WaveNet-UnderwaterImage- Restoration.
引用
收藏
页数:23
相关论文
共 50 条
  • [31] Improvement of single wavelength-based Thai jasmine rice identification with elliptic Fourier descriptor and neural network analysis
    Physics Department, Faculty of Science, King Mongkut's Institute of Technology Ladkrabang, Bangkok, Thailand
    不详
    Proc SPIE Int Soc Opt Eng,
  • [32] A Neural Network Based Solution to Color Image Restoration Problem
    Chickerur, Satyadhyan
    Kumar, M. Aswatha
    INFORMATION AND COMMUNICATION TECHNOLOGIES, 2010, 101 : 666 - 671
  • [33] Image restoration based on wavelet decomposition and RBF neural network
    Yang Aiping
    Wang Chengyou
    Hou Zhengxin
    Proceedings of the First International Symposium on Test Automation & Instrumentation, Vols 1 - 3, 2006, : 392 - 396
  • [34] An image restoration algorithm based on improved RBF neural network
    Zhao, Xuezhang
    Liu, Zhiyuan
    Xi, Yunjiang
    FRONTIERS OF ADVANCED MATERIALS AND ENGINEERING TECHNOLOGY, PTS 1-3, 2012, 430-432 : 1671 - +
  • [35] Research on image restoration algorithms based on BP neural network
    Xue, Hongzhi
    Cui, Hongwei
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 59 : 204 - 209
  • [36] A Local Characteristic Image Restoration Based on Convolutional Neural Network
    Lyu, Guohao
    Yin, Hui
    Yu, Xinyan
    Luo, Siwei
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2016, E99D (08): : 2190 - 2193
  • [37] Convolutional Neural Network-based Image Restoration (CNNIR)
    Huang, Zheng-Jie
    Lu, Wei-Hao
    Patel, Brijesh
    Chiu, Po-Yan
    Yang, Tz-Yu
    Tong, Hao Jian
    Bucinskas, Vytautas
    Greitans, Modris
    Lin, Po Ting
    2022 18TH IEEE/ASME INTERNATIONAL CONFERENCE ON MECHATRONIC AND EMBEDDED SYSTEMS AND APPLICATIONS (MESA 2022), 2022,
  • [38] A Variational neural network for image restoration based on coupled regularizers
    Guangyu Yang
    Weibo Wei
    Zhenkuan Pan
    Multimedia Tools and Applications, 2024, 83 : 12379 - 12401
  • [39] Noisy Image Restoration Based on Optimized Cellular Neural Network
    Aberomand, Nima
    Jameii, Seyed Mandi
    2015 2ND INTERNATIONAL CONFERENCE ON KNOWLEDGE-BASED ENGINEERING AND INNOVATION (KBEI), 2015, : 1194 - 1197
  • [40] Restoration and Enhancement of Fuzzy Defect Image Based on Neural Network
    Cui, Zhan-Peng
    Journal of Computers (Taiwan), 2023, 34 (04) : 1 - 14