Using machine learning to correct model error in data assimilation and forecast applications

被引:63
|
作者
Farchi, Alban [1 ]
Laloyaux, Patrick [2 ]
Bonavita, Massimo [2 ]
Bocquet, Marc [1 ]
机构
[1] CEREA, Joint Lab Ecole Ponts ParisTech & EDF R&D, Champs Sur Marne, France
[2] ECMWF, Shinfield Pk, Reading, Berks, England
关键词
data assimilation; machine learning; model error; neural networks; surrogate model; COMBINING DATA ASSIMILATION; NEURAL-NETWORKS; WEATHER; DYNAMICS; TIME;
D O I
10.1002/qj.4116
中图分类号
P4 [大气科学(气象学)];
学科分类号
0706 ; 070601 ;
摘要
The idea of using machine learning (ML) methods to reconstruct the dynamics of a system is the topic of recent studies in the geosciences, in which the key output is a surrogate model meant to emulate the dynamical model. In order to treat sparse and noisy observations in a rigorous way, ML can be combined with data assimilation (DA). This yields a class of iterative methods in which, at each iteration, a DA step assimilates the observations and alternates with a ML step to learn the underlying dynamics of the DA analysis. In this article, we propose to use this method to correct the error of an existing, knowledge-based model. In practice, the resulting surrogate model is a hybrid model between the original (knowledge-based) model and the ML model. We demonstrate the feasibility of the method numerically using a two-layer, two-dimensional, quasi-geostrophic channel model. Model error is introduced by the means of perturbed parameters. The DA step is performed using the strong-constraint 4D-Var algorithm, while the ML step is performed using deep learning tools. The ML models are able to learn a substantial part of the model error and the resulting hybrid surrogate models produce better short- to mid-range forecasts. Furthermore, using the hybrid surrogate models for DA yields a significantly better analysis than using the original model.
引用
收藏
页码:3067 / 3084
页数:18
相关论文
共 50 条
  • [1] Air Quality Forecast through Integrated Data Assimilation and Machine Learning
    Lin, Hai Xiang
    Jin, Jianbing
    van den Herik, Jaap
    [J]. PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE (ICAART), VOL 2, 2019, : 787 - 793
  • [2] Non-Gaussian Detection Using Machine Learning With Data Assimilation Applications
    Goodliff, Michael R.
    Fletcher, Steven J.
    Kliewer, Anton J.
    Jones, Andrew S.
    Forsythe, John M.
    [J]. EARTH AND SPACE SCIENCE, 2022, 9 (04)
  • [3] A comparison of combined data assimilation and machine learning methods for offline and online model error correction
    Farchi, Alban
    Bocquet, Marc
    Laloyaux, Patrick
    Bonavita, Massimo
    Malartic, Quentin
    [J]. JOURNAL OF COMPUTATIONAL SCIENCE, 2021, 55
  • [4] Adjoint sensitivity of the model forecast to data assimilation system error covariance parameters
    Daescu, Dacian N.
    Todling, Ricardo
    [J]. QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY, 2010, 136 (653) : 2000 - 2012
  • [5] DATA ASSIMILATION BY STATISTICAL INTERPOLATION OF FORECAST ERROR FIELDS
    RUTHERFORD, ID
    [J]. JOURNAL OF THE ATMOSPHERIC SCIENCES, 1972, 29 (05) : 809 - +
  • [6] Wave data assimilation using ensemble error covariances for operational wave forecast
    Sannasiraj, S. A.
    Babovic, Vladan
    Chan, Eng Soon
    [J]. OCEAN MODELLING, 2006, 14 (1-2) : 102 - 121
  • [7] On-line machine-learning forecast uncertainty estimation for sequential data assimilation
    Sacco, Maximiliano A.
    Pulido, Manuel
    Ruiz, Juan J.
    Tandeo, Pierre
    [J]. QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY, 2024, 150 (762) : 2937 - 2954
  • [8] Fast data assimilation (FDA): Data assimilation by machine learning for faster optimize model state
    Wu, Pin
    Chang, Xuting
    Yuan, Wenyan
    Sun, Junwu
    Zhang, Wenjie
    Arcucci, Rossella
    Guo, Yike
    [J]. JOURNAL OF COMPUTATIONAL SCIENCE, 2021, 51
  • [9] Data Learning: Integrating Data Assimilation and Machine Learning
    Buizza, Caterina
    Casas, Cesar Quilodran
    Nadler, Philip
    Mack, Julian
    Marrone, Stefano
    Titus, Zainab
    Le Cornec, Clemence
    Heylen, Evelyn
    Dur, Tolga
    Ruiz, Luis Baca
    Heaney, Claire
    Lopez, Julio Amador Diaz
    Kumar, K. S. Sesh
    Arcucci, Rossella
    [J]. JOURNAL OF COMPUTATIONAL SCIENCE, 2022, 58
  • [10] Forecast sensitivity to the observation error covariance in variational data assimilation
    Daescu, Dacian N.
    [J]. ICCS 2010 - INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE, PROCEEDINGS, 2010, 1 (01): : 1271 - 1279