Advancing Realistic Precipitation Nowcasting With a Spatiotemporal Transformer-Based Denoising Diffusion Model

被引:4
|
作者
Zhao, Zewei [1 ,2 ]
Dong, Xichao [1 ,2 ,3 ]
Wang, Yupei [1 ,2 ]
Hu, Cheng [1 ,2 ]
机构
[1] Beijing Inst Technol, Sch Informat & Elect, Minist Educ, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Minist Educ, Key Lab Elect & Informat Technol Satellite Nav, Beijing 100081, Peoples R China
[3] Beijing Inst Technol Chongqing Innovat Ctr, Chongqing Key Lab Novel Civilian Radar, Chongqing 401120, Peoples R China
关键词
Precipitation; Noise reduction; Predictive models; Spatiotemporal phenomena; Radar; Radar imaging; Measurement; Backbone design for diffusion models; conditional denoising diffusion model; generative learning; nowcasting; PREDICTABILITY; PREDICTION;
D O I
10.1109/TGRS.2024.3355755
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Recent advances in deep learning (DL) have significantly improved the quality of precipitation nowcasting. Current approaches are either based on deterministic or generative models. Deterministic models perceive nowcasting as a spatiotemporal prediction task, relying on distance functions like $L2$ -norm loss for training. While improving meteorological evaluation metrics, they inevitably produce blurry predictions with no reference value. In contrast, generative models aim to capture realistic precipitation distributions and generate nowcasting products by sampling within these distributions. However, designing a generative model that produces realistic samples satisfying meteorological evaluation indexes in real-time remains challenging, given the triple dilemma of generative learning: achieving high sample quality, mode coverage, and fast sampling simultaneously. Recently, diffusion models exhibit impressive sample quality but suffer from time-consuming sampling, severely hindering their application in nowcasting. Moreover, samples generated by the U-Net denoiser of the current denoising diffusion model are prone to yield poor meteorological evaluation metrics such as CSI. To this end, we propose a spatiotemporal transformer-based conditional diffusion model with a rapid diffusion strategy. Concretely, we incorporate an adversarial mapping-based rapid diffusion strategy to overcome the time-consuming sampling process for standard diffusion models, enabling timely nowcasting. In addition, a meticulously designed spatiotemporal transformer-based denoiser is incorporated into diffusion models, remedying the defects in U-Net denoisers by estimating diffusion scores and improving nowcasting skill scores. Case studies of typical weather events such as thunderstorms, as well as quantitative indicators, demonstrate the effectiveness of the proposed method in generating sharper and more precise precipitation forecasts while maintaining satisfied meteorological evaluation metrics.
引用
收藏
页码:1 / 15
页数:15
相关论文
共 50 条
  • [1] TransDDPM: Transformer-Based Denoising Diffusion Probabilistic Model for Image Restoration
    Wei, Pan
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT XI, 2024, 14435 : 250 - 263
  • [2] SCRD: A Spatiotemporal Cues-Guided Residual Diffusion Model for Precipitation Nowcasting
    Li, Yinghao
    Niu, Dan
    Li, Yi
    Zang, Zengliang
    Wang, Hongbin
    Jiang, Mingbo
    IEEE Geoscience and Remote Sensing Letters, 2024, 21
  • [3] Precipitation Nowcasting Using Diffusion Transformer with Causal Attention
    Li, Chaorong
    Ling, Xudong
    Xue, Yilan
    Luo, Wenjie
    Zhu, Lihong
    Qin, Fengqing
    Zhou, Yaodong
    Huang, Yuanyuan
    IEEE Transactions on Geoscience and Remote Sensing, 2024, 62
  • [4] Precipitation nowcasting using transformer-based generative models and transfer learning for improved disaster preparedness
    Piran, Md. Jalil
    Wang, Xiaoding
    Kim, Ho Jun
    Kwon, Hyun Han
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 132
  • [5] Spatiotemporal Feature Fusion Transformer for Precipitation Nowcasting via Feature Crossing
    Xiong, Taisong
    Wang, Weiping
    He, Jianxin
    Su, Rui
    Wang, Hao
    Hu, Jinrong
    REMOTE SENSING, 2024, 16 (14)
  • [6] 2D medical image synthesis using transformer-based denoising diffusion probabilistic model
    Pan, Shaoyan
    Wang, Tonghe
    Qiu, Richard L. J.
    Axente, Marian
    Chang, Chih-Wei
    Peng, Junbo
    Patel, Ashish B.
    Shelton, Joseph
    Patel, Sagar A.
    Roper, Justin
    Yang, Xiaofeng
    PHYSICS IN MEDICINE AND BIOLOGY, 2023, 68 (10):
  • [7] LayoutDM: Transformer-based Diffusion Model for Layout Generation
    Chai, Shang
    Zhuang, Liansheng
    Yan, Fengying
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 18349 - 18358
  • [8] Transformer-Based Spatiotemporal Graph Diffusion Convolution Network for Traffic Flow Forecasting
    Wei, Siwei
    Yang, Yang
    Liu, Donghua
    Deng, Ke
    Wang, Chunzhi
    ELECTRONICS, 2024, 13 (16)
  • [9] Successful Precipitation Downscaling Through an Innovative Transformer-Based Model
    Yang, Fan
    Ye, Qiaolin
    Wang, Kai
    Sun, Le
    Remote Sensing, 2024, 16 (22)
  • [10] Synthetic CT generation from MRI using 3D transformer-based denoising diffusion model
    Pan, Shaoyan
    Abouei, Elham
    Wynne, Jacob
    Chang, Chih-Wei
    Wang, Tonghe
    Qiu, Richard L. J.
    Li, Yuheng
    Peng, Junbo
    Roper, Justin
    Patel, Pretesh
    Yu, David S.
    Mao, Hui
    Yang, Xiaofeng
    MEDICAL PHYSICS, 2024, 51 (04) : 2538 - 2548