A Hybrid Data-Driven and Data Assimilation Method for Spatiotemporal Forecasting: PM2.5 Forecasting in China

Spatiotemporal forecasting involves generating temporal forecasts for system state variables across spatial regions. Data-driven methods such as Convolutional Long Short-Term Memory (ConvLSTM) are effective in capturing both spatial and temporal correlations, but they suffer from error accumulation and accuracy loss as forecasting time increases due to the nonlinearity and uncertainty in physical processes. To address this issue, we propose to combine data-driven and data assimilation (DA) methods for spatiotemporal forecasting. The accuracy of the data-driven ConvLSTM model can be improved by periodically assimilating real-time observations using the ensemble Kalman filter (EnKF) approach. This proposed hybrid ConvLSTM-EnKF method is demonstrated through PM2.5 forecasting in China, which is a challenging task due to the complexity of topographical and meteorological conditions in the region, the need for high-resolution forecasting over a large study area, and the scarcity of observations. The results show that the ConvLSTM-EnKF method outperforms conventional methods and can provide satisfactory operational PM2.5 forecasts for up to 1 month with spatially averaged RMSE below 20 mu g/m3 and correlation coefficient (R) above 0.8. In addition, the ConvLSTM-EnKF method shows a substantial reduction in CPU time when compared to the commonly used NAQPMS-EnKF method, up to three orders of magnitude. Overall, the use of data-driven models provides efficient forecasts and speeds up DA. This hybrid ConvLSTM-EnKF is a novel operational forecasting technique for spatiotemporal forecasting and is used in real spatiotemporal forecasting for the first time. This study introduces an advanced method (ConvLSTM-EnKF) for PM2.5 forecasting in China, which is a challenging task due to its large area coverage, and complex topographical and meteorological conditions. This innovative approach combines two techniques: one looks at historical data to make forecasts, while the other periodically incorporates new information from observations to improve forecasts over time. This combination significantly improves forecasting accuracy and provides reliable operational PM2.5 forecasts for up to 1 month. Notably, this method is more efficient than traditional approaches. Beyond air pollution, the method holds promise for improving predictions in other areas, including weather, climate, and environmental systems, marking a substantial step forward in our ability to anticipate and understand complex spatiotemporal phenomena. A hybrid data-driven (ConvLSTM) and data assimilation (EnKF) method is proposed for accurate and efficient spatiotemporal forecasting. A pre-trained ConvLSTM is used for both the forecasting and assimilation processes, enabling fast online operational forecasting The ConvLSTM-EnKF demonstrates high efficiency by reducing CPU time by three orders of magnitude compared to the NAQPMS-EnKF, a widely used air quality forecasting model in China The ConvLSTM-EnKF enables online data assimilation (DA) for high-dimensional systems and improves DA accuracy by allowing the use of a large ensemble size