Data-Driven Model Uncertainty Estimation in Hydrologic Data Assimilation

被引:67
|
作者
Pathiraja, S. [1 ,2 ]
Moradkhani, H. [3 ]
Marshall, L. [2 ]
Sharma, A. [2 ]
Geenens, G. [4 ]
机构
[1] Univ Potsdam, Inst Math, Potsdam, Germany
[2] Univ New South Wales, Sch Civil & Environm Engn, Water Res Ctr, Sydney, NSW, Australia
[3] Portland State Univ, Dept Civil & Environm Engn, Portland, OR 97207 USA
[4] Univ New South Wales, Sch Math & Stat, Sydney, NSW, Australia
基金
澳大利亚研究理事会;
关键词
data assimilation; model error; uncertainty quantification; particle filter; nonparametric statistics; SEQUENTIAL DATA ASSIMILATION; ENSEMBLE DATA ASSIMILATION; SOIL-MOISTURE; PARAMETER-ESTIMATION; PARTICLE FILTER; KALMAN FILTER; PROBABILISTIC PREDICTION; STREAMFLOW OBSERVATIONS; INITIAL CONDITION; ERROR;
D O I
10.1002/2018WR022627
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The increasing availability of earth observations necessitates mathematical methods to optimally combine such data with hydrologic models. Several algorithms exist for such purposes, under the umbrella of data assimilation (DA). However, DA methods are often applied in a suboptimal fashion for complex real-world problems, due largely to several practical implementation issues. One such issue is error characterization, which is known to be critical for a successful assimilation. Mischaracterized errors lead to suboptimal forecasts, and in the worst case, to degraded estimates even compared to the no assimilation case. Model uncertainty characterization has received little attention relative to other aspects of DA science. Traditional methods rely on subjective, ad hoc tuning factors or parametric distribution assumptions that may not always be applicable. We propose a novel data-driven approach (named SDMU) to model uncertainty characterization for DA studies where (1) the system states are partially observed and (2) minimal prior knowledge of the model error processes is available, except that the errors display state dependence. It includes an approach for estimating the uncertainty in hidden model states, with the end goal of improving predictions of observed variables. The SDMU is therefore suited to DA studies where the observed variables are of primary interest. Its efficacy is demonstrated through a synthetic case study with low-dimensional chaotic dynamics and a real hydrologic experiment for one-day-ahead streamflow forecasting. In both experiments, the proposed method leads to substantial improvements in the hidden states and observed system outputs over a standard method involving perturbation with Gaussian noise.
引用
收藏
页码:1252 / 1280
页数:29
相关论文
共 50 条
  • [1] Uncertainty Estimation for Data-Driven Visual Odometry
    Costante, Gabriele
    Mancini, Michele
    [J]. IEEE TRANSACTIONS ON ROBOTICS, 2020, 36 (06) : 1738 - 1757
  • [2] Integrating Recurrent Neural Networks With Data Assimilation for Scalable Data-Driven State Estimation
    Penny, S. G.
    Smith, T. A.
    Chen, T-C
    Platt, J. A.
    Lin, H-Y
    Goodliff, M.
    Abarbanel, H. D., I
    [J]. JOURNAL OF ADVANCES IN MODELING EARTH SYSTEMS, 2022, 14 (03)
  • [3] Data-driven surrogate model with latent data assimilation: Application to wildfire forecasting
    Cheng, Sibo
    Prentice, I. Colin
    Huang, Yuhan
    Jin, Yufang
    Guo, Yi-Ke
    Arcucci, Rossella
    [J]. JOURNAL OF COMPUTATIONAL PHYSICS, 2022, 464
  • [4] Data-driven learning of differential equations: combining data and model uncertainty
    Glasner, Karl
    [J]. COMPUTATIONAL & APPLIED MATHEMATICS, 2023, 42 (01):
  • [5] Data-driven learning of differential equations: combining data and model uncertainty
    Karl Glasner
    [J]. Computational and Applied Mathematics, 2023, 42
  • [6] Data-driven probabilistic energy consumption estimation for battery electric vehicles with model uncertainty
    Maity, Ayan
    Sarkar, Sudeshna
    [J]. INTERNATIONAL JOURNAL OF GREEN ENERGY, 2024, 21 (09) : 1986 - 2003
  • [7] Uncertainty in hydrologic modeling: Toward an integrated data assimilation framework
    Liu, Yuqiong
    Gupta, Hoshin V.
    [J]. WATER RESOURCES RESEARCH, 2007, 43 (07)
  • [8] Flood Forecasting and Uncertainty Assessment with Sequential Data Assimilation using a Distributed Hydrologic Model
    Noh, Seong Jin
    Kim, Kyoungjun
    Tachikawa, Yasuto
    Shiiba, Michiharu
    [J]. 2013 16TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2013, : 1378 - 1384
  • [9] A Data-Driven Method for Hybrid Data Assimilation with Multilayer Perceptron
    Huang, Lilan
    Leng, Hongze
    Li, Xiaoyong
    Ren, Kaijun
    Song, Junqiang
    Wang, Dongzi
    [J]. BIG DATA RESEARCH, 2021, 23
  • [10] Strategic Use of Data Assimilation for Dynamic Data-Driven Simulation
    Cho, Yubin
    Huang, Yilin
    Verbraeck, Alexander
    [J]. COMPUTATIONAL SCIENCE - ICCS 2020, PT VI, 2020, 12142 : 31 - 44