Advancing Realistic Precipitation Nowcasting With a Spatiotemporal Transformer-Based Denoising Diffusion Model

被引:4
|
作者
Zhao, Zewei [1 ,2 ]
Dong, Xichao [1 ,2 ,3 ]
Wang, Yupei [1 ,2 ]
Hu, Cheng [1 ,2 ]
机构
[1] Beijing Inst Technol, Sch Informat & Elect, Minist Educ, Beijing 100081, Peoples R China
[2] Beijing Inst Technol, Minist Educ, Key Lab Elect & Informat Technol Satellite Nav, Beijing 100081, Peoples R China
[3] Beijing Inst Technol Chongqing Innovat Ctr, Chongqing Key Lab Novel Civilian Radar, Chongqing 401120, Peoples R China
关键词
Precipitation; Noise reduction; Predictive models; Spatiotemporal phenomena; Radar; Radar imaging; Measurement; Backbone design for diffusion models; conditional denoising diffusion model; generative learning; nowcasting; PREDICTABILITY; PREDICTION;
D O I
10.1109/TGRS.2024.3355755
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Recent advances in deep learning (DL) have significantly improved the quality of precipitation nowcasting. Current approaches are either based on deterministic or generative models. Deterministic models perceive nowcasting as a spatiotemporal prediction task, relying on distance functions like $L2$ -norm loss for training. While improving meteorological evaluation metrics, they inevitably produce blurry predictions with no reference value. In contrast, generative models aim to capture realistic precipitation distributions and generate nowcasting products by sampling within these distributions. However, designing a generative model that produces realistic samples satisfying meteorological evaluation indexes in real-time remains challenging, given the triple dilemma of generative learning: achieving high sample quality, mode coverage, and fast sampling simultaneously. Recently, diffusion models exhibit impressive sample quality but suffer from time-consuming sampling, severely hindering their application in nowcasting. Moreover, samples generated by the U-Net denoiser of the current denoising diffusion model are prone to yield poor meteorological evaluation metrics such as CSI. To this end, we propose a spatiotemporal transformer-based conditional diffusion model with a rapid diffusion strategy. Concretely, we incorporate an adversarial mapping-based rapid diffusion strategy to overcome the time-consuming sampling process for standard diffusion models, enabling timely nowcasting. In addition, a meticulously designed spatiotemporal transformer-based denoiser is incorporated into diffusion models, remedying the defects in U-Net denoisers by estimating diffusion scores and improving nowcasting skill scores. Case studies of typical weather events such as thunderstorms, as well as quantitative indicators, demonstrate the effectiveness of the proposed method in generating sharper and more precise precipitation forecasts while maintaining satisfied meteorological evaluation metrics.
引用
收藏
页码:1 / 15
页数:15
相关论文
共 50 条
  • [41] Spacetime Separable Latent Diffusion Model With Intensity Structure Information for Precipitation Nowcasting
    Ling, Xudong
    Li, Chaorong
    Zhu, Lihong
    Qin, Fengqing
    Zhu, Ping
    Huang, Yuanyuan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [42] MDTNet: Multiscale Deformable Transformer Network With Fourier Space Losses Toward Fine-Scale Spatiotemporal Precipitation Nowcasting
    Zhao, Zewei
    Dong, Xichao
    Wang, Yupei
    Wang, Jianping
    Chen, Yubao
    Hu, Cheng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [43] Transformer-Based Unified Neural Network for Quality Estimation and Transformer-Based Re-decoding Model for Machine Translation
    Chen, Cong
    Zong, Qinqin
    Luo, Qi
    Qiu, Bailian
    Li, Maoxi
    MACHINE TRANSLATION, CCMT 2020, 2020, 1328 : 66 - 75
  • [44] Transformative Noise Reduction: Leveraging a Transformer-Based Deep Network for Medical Image Denoising
    Naqvi, Rizwan Ali
    Haider, Amir
    Kim, Hak Seob
    Jeong, Daesik
    Lee, Seung-Won
    MATHEMATICS, 2024, 12 (15)
  • [45] Precipitation Nowcasting by a Spectral-Based Nonlinear Stochastic Model
    Metta, Sabino
    von Hardenberg, Jost
    Ferraris, Luca
    Rebora, Nicola
    Provenzale, Antonello
    JOURNAL OF HYDROMETEOROLOGY, 2009, 10 (05) : 1285 - 1297
  • [46] A Swin Transformer-based model for mosquito species identification
    Zhao, De-zhong
    Wang, Xin-kai
    Zhao, Teng
    Li, Hu
    Xing, Dan
    Gao, He-ting
    Song, Fan
    Chen, Guo-hua
    Li, Chun-xiao
    SCIENTIFIC REPORTS, 2022, 12 (01)
  • [47] A Swin Transformer-based model for mosquito species identification
    De-zhong Zhao
    Xin-kai Wang
    Teng Zhao
    Hu Li
    Dan Xing
    He-ting Gao
    Fan Song
    Guo-hua Chen
    Chun-xiao Li
    Scientific Reports, 12
  • [48] AN EFFICIENT TRANSFORMER-BASED MODEL FOR VOICE ACTIVITY DETECTION
    Zhao, Yifei
    Champagne, Benoit
    2022 IEEE 32ND INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2022,
  • [49] DLGNet: A Transformer-based Model for Dialogue Response Generation
    Olabiyi, Oluwatobi
    Mueller, Erik T.
    NLP FOR CONVERSATIONAL AI, 2020, : 54 - 62
  • [50] TRANSQL: A Transformer-based Model for Classifying SQL Queries
    Tahmasebi, Shirin
    Payberah, Amir H.
    Paragraph, Ahmet Soylu
    Roman, Dumitru
    Matskin, Mihhail
    2022 21ST IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS, ICMLA, 2022, : 788 - 793