UCL-Dehaze: Toward Real-World Image Dehazing via Unsupervised Contrastive Learning

被引:10
|
作者
Wang, Yongzhen [1 ,2 ]
Yan, Xuefeng [1 ,3 ]
Wang, Fu Lee [4 ]
Xie, Haoran [5 ]
Yang, Wenhan [6 ]
Zhang, Xiao-Ping [7 ,8 ]
Qin, Jing [9 ]
Wei, Mingqiang [1 ,3 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Sch Comp Sci & Technol, Nanjing 210016, Peoples R China
[2] Anhui Univ Technol, Sch Comp Sci & Technol, Maanshan 243032, Peoples R China
[3] Nanjing Univ Aeronaut & Astronaut, Shenzhen Inst Res, Shenzhen 518038, Peoples R China
[4] Hong Kong Metropolitan Univ, Sch Sci & Technol, Hong Kong, Peoples R China
[5] Lingnan Univ, Dept Comp & Decis Sci, Hong Kong, Peoples R China
[6] Peng Cheng Lab, Shenzhen 518000, Peoples R China
[7] Tsinghua Berkeley Shenzhen Inst, Shenzhen 518055, Peoples R China
[8] Toronto Metropolitan Univ, Dept Elect Comp & Biomed Engn, Toronto, ON M5B 2K3, Canada
[9] Hong Kong Polytech Univ, Sch Nursing, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Training; Self-supervised learning; Image restoration; Image color analysis; Atmospheric modeling; Task analysis; Synthetic data; UCL-Dehaze; image dehazing; unsupervised contrastive learning; unpaired data; adversarial training; GATED FUSION NETWORK; QUALITY ASSESSMENT;
D O I
10.1109/TIP.2024.3362153
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
While the wisdom of training an image dehazing model on synthetic hazy data can alleviate the difficulty of collecting real-world hazy/clean image pairs, it brings the well-known domain shift problem. From a different yet new perspective, this paper explores contrastive learning with an adversarial training effort to leverage unpaired real-world hazy and clean images, thus alleviating the domain shift problem and enhancing the network's generalization ability in real-world scenarios. We propose an effective unsupervised contrastive learning paradigm for image dehazing, dubbed UCL-Dehaze. Unpaired real-world clean and hazy images are easily captured, and will serve as the important positive and negative samples respectively when training our UCL-Dehaze network. To train the network more effectively, we formulate a new self-contrastive perceptual loss function, which encourages the restored images to approach the positive samples and keep away from the negative samples in the embedding space. Besides the overall network architecture of UCL-Dehaze, adversarial training is utilized to align the distributions between the positive samples and the dehazed images. Compared with recent image dehazing works, UCL-Dehaze does not require paired data during training and utilizes unpaired positive/negative data to better enhance the dehazing performance. We conduct comprehensive experiments to evaluate our UCL-Dehaze and demonstrate its superiority over the state-of-the-arts, even only 1,800 unpaired real-world images are used to train our network.
引用
收藏
页码:1361 / 1374
页数:14
相关论文
共 50 条
  • [1] Underwater Image Restoration via Contrastive Learning and a Real-World Dataset
    Han, Junlin
    Shoeiby, Mehrdad
    Malthus, Tim
    Botha, Elizabeth
    Anstee, Janet
    Anwar, Saeed
    Wei, Ran
    Armin, Mohammad Ali
    Li, Hongdong
    Petersson, Lars
    [J]. REMOTE SENSING, 2022, 14 (17)
  • [2] Contrastive adaptive frequency decomposition network guided by haze discrimination for real-world image dehazing
    Mo, Yaozong
    Li, Chaofeng
    [J]. DISPLAYS, 2024, 82
  • [3] Real-World Image Deblurring via Unsupervised Domain Adaptation
    Liu, Hanzhou
    Li, Binghan
    Lu, Mi
    Wu, Yucheng
    [J]. ADVANCES IN VISUAL COMPUTING, ISVC 2023, PT II, 2023, 14362 : 148 - 159
  • [4] Unsupervised Image Enhancement via Contrastive Learning
    Li, Di
    Rahardja, Susanto
    [J]. 2024 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS 2024, 2024,
  • [5] Joint dual-teacher distillation and unsupervised fusion for unpaired real-world image dehazing
    Qiao, Yingxu
    Zhan, Xiyan
    Luo, Fen
    Huo, Zhanqiang
    [J]. COMPLEX & INTELLIGENT SYSTEMS, 2024, 10 (04) : 5669 - 5681
  • [6] UNSUPERVISED DOMAIN ADAPTIVE LEARNING FOR IMAGE DESNOWING WITH REAL-WORLD DATA
    Ren, Jingxu
    Zhou, Gang
    Zhu, Yusen
    Liu, Yangxin
    Chen, Juan
    Jia, Zhenhong
    [J]. 2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3050 - 3054
  • [7] Real-World Image Deraining Using Model-Free Unsupervised Learning
    Yu, Rongwei
    Xiang, Jingyi
    Shu, Ni
    Zhang, Peihao
    Li, Yizhan
    Shen, Yiyang
    Wang, Weiming
    Wang, Lina
    [J]. INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2024, 2024
  • [8] Real-world image dehazing with improved joint enhancement and exposure fusion
    Kaplan, Nur Huseyin
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 90
  • [9] Joint Contrast Enhancement and Exposure Fusion for Real-World Image Dehazing
    Liu, Xiaoning
    Li, Hui
    Zhu, Ce
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 3934 - 3946
  • [10] Source-Free Domain Adaptation for Real-World Image Dehazing
    Yu, Hu
    Huang, Jie
    Liu, Yajing
    Zhu, Qi
    Zhou, Man
    Zhao, Feng
    [J]. PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 6645 - 6654