USIR-Net: sand-dust image restoration based on unsupervised learning

被引:1
|
作者
Ding, Yuan [1 ]
Wu, Kaijun [1 ]
机构
[1] Lanzhou Jiaotong Univ, Coll Elect & Informat Engn, Lanzhou 730070, Gansu, Peoples R China
关键词
Image denoising; Image enhancement; Unsupervised adversarial learning; Adaptive learning; Sand-dust image restoration; ENHANCEMENT;
D O I
10.1007/s00138-024-01528-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In sand-dust weather, the influence of sand-dust particles on imaging equipment often results in images with color deviation, blurring, and low contrast, among other issues. These problems making many traditional image restoration methods unable to accurately estimate the semantic information of the images and consequently resulting in poor restoration of clear images. Most current image restoration methods in the field of deep learning are based on supervised learning, which requires pairing and labeling a large amount of data, and the possibility of manual annotation errors. In light of this, we propose an unsupervised sand-dust image restoration network. The overall model adopts an improved CycleGAN to fit unpaired sand-dust images. Firstly, multiscale skip connections in the multiscale cascaded attention module are used to enhance the feature fusion effect after downsampling. Secondly, multi-head convolutional attention with multiple input concatenations is employed, with each head using different kernel sizes to improve the ability to restore detail information. Finally, the adaptive decoder-encoder module is used to achieve adaptive fitting of the model and output the restored image. According to the experiments conducted on the dataset, the qualitative and quantitative indicators of USIR-Net are superior to the selected comparison algorithms, furthermore, in additional experiments conducted on haze removal and underwater image enhancement, we have demonstrated the wide applicability of our model.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] USIR-Net: sand-dust image restoration based on unsupervised learning
    Yuan Ding
    Kaijun Wu
    Machine Vision and Applications, 2024, 35
  • [2] Restoration of Single Sand-Dust Image Based on Style Transformation and Unsupervised Adversarial Learning
    Ding, Bosheng
    Chen, Huimin
    Xu, Lixin
    Zhang, Ruiheng
    IEEE ACCESS, 2022, 10 : 90092 - 90100
  • [3] Sand-Dust Image Restoration Based on Reversing the Blue Channel Prior
    Gao, GuXue
    Lai, HuiCheng
    Jia, ZhenHong
    Liu, YueQin
    Wang, YaLi
    IEEE PHOTONICS JOURNAL, 2020, 12 (02):
  • [4] Two-Step Unsupervised Approach for Sand-Dust Image Enhancement
    Gao, Guxue
    Lai, Huicheng
    Jia, Zhenhong
    INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2023, 2023
  • [5] Sand-dust Image Restoration Using Gray Compensation and Feature Fusion
    Ding B.
    Zhang R.
    Xu L.
    Chen H.
    Binggong Xuebao/Acta Armamentarii, 2023, 44 (10): : 3115 - 3126
  • [6] Single sand-dust image restoration using information loss constraint
    Yu, Shunyuan
    Zhu, Hong
    Wang, Jing
    Fu, Zhengfang
    Xue, Shan
    Shi, Hua
    JOURNAL OF MODERN OPTICS, 2016, 63 (21) : 2121 - 2130
  • [7] Sand-dust image enhancement based on Lab color space
    Niu, Hongxia
    Zhang, Hongzhu
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2024, 39 (09) : 1274 - 1284
  • [8] Hierarchical contrastive learning and color standardization for single image sand-dust removal
    Si, Yazhong
    Xu, Mengjia
    Yang, Fan
    PATTERN ANALYSIS AND APPLICATIONS, 2024, 27 (01)
  • [9] Sand-dust image enhancement based on light attenuation and transmission compensation
    Fei Shi
    Zhenhong Jia
    Huicheng Lai
    Nikola K. Kasabov
    Sensen Song
    Junnan Wang
    Multimedia Tools and Applications, 2023, 82 : 7055 - 7077
  • [10] Sand-Dust Image Enhancement Based on Color Correction And Haze Removal
    Shi, Zhenghao
    Zhou, Zhaorun
    Feng, Yaning
    THIRTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2021), 2022, 12083