Using machine learning to correct model error in data assimilation and forecast applications

被引:63
|
作者
Farchi, Alban [1 ]
Laloyaux, Patrick [2 ]
Bonavita, Massimo [2 ]
Bocquet, Marc [1 ]
机构
[1] CEREA, Joint Lab Ecole Ponts ParisTech & EDF R&D, Champs Sur Marne, France
[2] ECMWF, Shinfield Pk, Reading, Berks, England
关键词
data assimilation; machine learning; model error; neural networks; surrogate model; COMBINING DATA ASSIMILATION; NEURAL-NETWORKS; WEATHER; DYNAMICS; TIME;
D O I
10.1002/qj.4116
中图分类号
P4 [大气科学(气象学)];
学科分类号
0706 ; 070601 ;
摘要
The idea of using machine learning (ML) methods to reconstruct the dynamics of a system is the topic of recent studies in the geosciences, in which the key output is a surrogate model meant to emulate the dynamical model. In order to treat sparse and noisy observations in a rigorous way, ML can be combined with data assimilation (DA). This yields a class of iterative methods in which, at each iteration, a DA step assimilates the observations and alternates with a ML step to learn the underlying dynamics of the DA analysis. In this article, we propose to use this method to correct the error of an existing, knowledge-based model. In practice, the resulting surrogate model is a hybrid model between the original (knowledge-based) model and the ML model. We demonstrate the feasibility of the method numerically using a two-layer, two-dimensional, quasi-geostrophic channel model. Model error is introduced by the means of perturbed parameters. The DA step is performed using the strong-constraint 4D-Var algorithm, while the ML step is performed using deep learning tools. The ML models are able to learn a substantial part of the model error and the resulting hybrid surrogate models produce better short- to mid-range forecasts. Furthermore, using the hybrid surrogate models for DA yields a significantly better analysis than using the original model.
引用
收藏
页码:3067 / 3084
页数:18
相关论文
共 50 条
  • [31] Machine Learning for Targeted Assimilation of Satellite Data
    Lee, Yu-Ju
    Hall, David
    Stewart, Jebb
    Govett, Mark
    [J]. MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2018, PT III, 2019, 11053 : 53 - 68
  • [32] PHYSICS INFORMED MODEL ERROR FOR DATA ASSIMILATION
    Guillot, Jules
    Frenod, Emmanuel
    Ailliot, Pierre
    [J]. DISCRETE AND CONTINUOUS DYNAMICAL SYSTEMS-SERIES S, 2023, 16 (02): : 265 - 276
  • [33] The effect of numerical model error on data assimilation
    Jenkins, S. E.
    Budd, C. J.
    Freitag, M. A.
    Smith, N. D.
    [J]. JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2015, 290 : 567 - 588
  • [34] Using machine learning to forecast domestic homicide via police data and super learning
    Verrey, Jacob
    Ariel, Barak
    Harinam, Vincent
    Dillon, Luke
    [J]. SCIENTIFIC REPORTS, 2023, 13 (01)
  • [35] Using machine learning to forecast domestic homicide via police data and super learning
    Jacob Verrey
    Barak Ariel
    Vincent Harinam
    Luke Dillon
    [J]. Scientific Reports, 13
  • [36] Representing model error in ensemble data assimilation
    Cardinali, C.
    Zagar, N.
    Radnoti, G.
    Buizza, R.
    [J]. NONLINEAR PROCESSES IN GEOPHYSICS, 2014, 21 (05) : 971 - 985
  • [37] Using ensemble data assimilation to forecast hydrological flumes
    Amour, I.
    Mussa, Z.
    Bibov, A.
    Kauranne, T.
    [J]. NONLINEAR PROCESSES IN GEOPHYSICS, 2013, 20 (06) : 955 - 964
  • [38] Mechanistic machine learning: how data assimilation leverages physiologic knowledge using Bayesian inference to forecast the future, infer the present, and phenotype
    Albers, David J.
    Levine, Matthew E.
    Stuart, Andrew
    Mamykina, Lena
    Gluckman, Bruce
    Hripcsak, George
    [J]. JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION, 2018, 25 (10) : 1392 - 1401
  • [39] A review of forecast error covariance statistics in atmospheric variational data assimilation. II: Modelling the forecast error covariance statistics
    Bannister, R. N.
    [J]. QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY, 2008, 134 (637) : 1971 - 1996
  • [40] A review of forecast error covariance statistics in atmospheric variational data assimilation. I: Characteristics and measurements of forecast error covariances
    Bannister, R. N.
    [J]. QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY, 2008, 134 (637) : 1951 - 1970