Learning depth-aware decomposition for single image dehazing

被引:0
|
作者
Kang, Yumeng [1 ]
Zhang, Lu [2 ]
Hu, Ping [3 ]
Liu, Yu [4 ]
Lu, Huchuan [2 ]
He, You [4 ]
机构
[1] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen, Peoples R China
[2] Dalian Univ Technol, Dalian, Peoples R China
[3] Boston Univ, Boston, MA USA
[4] Tsinghua Univ, Beijing, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Single image dehazing; Denoising diffusion probabilistic models; Self-supervised learning;
D O I
10.1016/j.cviu.2024.104069
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image dehazing under deficient data is an ill-posed and challenging problem. Most existing methods tackle this task by developing either CycleGAN-based hazy-to-clean translation or physical-based haze decomposition. However, geometric structure is often not effectively incorporated in their straightforward hazy-clean projection framework, which might incur inaccurate estimation in distant areas. In this paper, we rethink the image dehazing task and propose a depth-aware perception framework, DehazeDP, , for robust haze decomposition on deficient data. Our DehazeDP is insthe pired by Diffusion Probabilistic Model to form an end-to-end training pipeline that seamlessly ines the hazy image generation with haze disentanglement. Specifically, in the forward phase, the haze is added to a clean image step-by-step according to the depth distribution. Then, in the reverse phase, a unified U-Net is used to predict the haze and recover the clean image progressively. Extensive experiments on public datasets demonstrate that the proposed DehazeDP performs favorably against state-of-the-art approaches. We release the code and models at https://github.com/stallak/DehazeDP.
引用
收藏
页数:10
相关论文
共 50 条
  • [31] Look Deeper See Richer: Depth-aware Image Paragraph Captioning
    Wang, Ziwei
    Luo, Yadan
    Li, Yang
    Huang, Zi
    Yin, Hongzhi
    PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, : 672 - 680
  • [32] Efficient Depth-aware Image Deformation Adaptation for Curved Screen Displays
    Lu, Shao-Ping
    Florea, Ruxandra-Marina
    Cesar, Pablo
    Schelkens, Peter
    Munteanu, Adrian
    PROCEEDINGS OF THE THEMATIC WORKSHOPS OF ACM MULTIMEDIA 2017 (THEMATIC WORKSHOPS'17), 2017, : 442 - 450
  • [33] DINER: Depth-aware Image-based NEural Radiance fields
    Prinzler, Malte
    Hilliges, Otmar
    Thies, Justus
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 12449 - 12459
  • [34] Single image dehazing via decomposition and enhancement
    Gu, Bo
    Yao, Haohan
    Sun, Yanjun
    Duan, Zhonghang
    IET IMAGE PROCESSING, 2024, 18 (04) : 1014 - 1027
  • [35] Depth-Aware Video Frame Interpolation
    Bao, Wenbo
    Lai, Wei-Sheng
    Ma, Chao
    Zhang, Xiaoyun
    Gao, Zhiyong
    Yang, Ming-Hsuan
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3698 - 3707
  • [36] Robust Unpaired Image Dehazing via Density and Depth Decomposition
    Yang, Yang
    Wang, Chaoyue
    Guo, Xiaojie
    Tao, Dacheng
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (05) : 1557 - 1577
  • [37] Robust Unpaired Image Dehazing via Density and Depth Decomposition
    Yang Yang
    Chaoyue Wang
    Xiaojie Guo
    Dacheng Tao
    International Journal of Computer Vision, 2024, 132 : 1557 - 1577
  • [38] PolyphonicFormer: Unified Query Learning for Depth-Aware Video Panoptic Segmentation
    Yuan, Haobo
    Li, Xiangtai
    Yang, Yibo
    Cheng, Guangliang
    Zhang, Jing
    Tong, Yunhai
    Zhang, Lefei
    Tao, Dacheng
    COMPUTER VISION - ECCV 2022, PT XXVII, 2022, 13687 : 582 - 599
  • [39] DEPTH-AWARE OBJECT INSTANCE SEGMENTATION
    Ye, Linwei
    Liu, Zhi
    Wang, Yang
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 325 - 329
  • [40] Single Image Dehazing with White Balance Correction and Image Decomposition
    He, Renjie
    Wang, Zhiyong
    Xiong, Hao
    Feng, David Dagan
    2012 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING TECHNIQUES AND APPLICATIONS (DICTA), 2012,