Data-Driven Model Uncertainty Estimation in Hydrologic Data Assimilation

被引:73
|
作者
Pathiraja, S. [1 ,2 ]
Moradkhani, H. [3 ]
Marshall, L. [2 ]
Sharma, A. [2 ]
Geenens, G. [4 ]
机构
[1] Univ Potsdam, Inst Math, Potsdam, Germany
[2] Univ New South Wales, Sch Civil & Environm Engn, Water Res Ctr, Sydney, NSW, Australia
[3] Portland State Univ, Dept Civil & Environm Engn, Portland, OR 97207 USA
[4] Univ New South Wales, Sch Math & Stat, Sydney, NSW, Australia
基金
澳大利亚研究理事会;
关键词
data assimilation; model error; uncertainty quantification; particle filter; nonparametric statistics; SEQUENTIAL DATA ASSIMILATION; ENSEMBLE DATA ASSIMILATION; SOIL-MOISTURE; PARAMETER-ESTIMATION; PARTICLE FILTER; KALMAN FILTER; PROBABILISTIC PREDICTION; STREAMFLOW OBSERVATIONS; INITIAL CONDITION; ERROR;
D O I
10.1002/2018WR022627
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The increasing availability of earth observations necessitates mathematical methods to optimally combine such data with hydrologic models. Several algorithms exist for such purposes, under the umbrella of data assimilation (DA). However, DA methods are often applied in a suboptimal fashion for complex real-world problems, due largely to several practical implementation issues. One such issue is error characterization, which is known to be critical for a successful assimilation. Mischaracterized errors lead to suboptimal forecasts, and in the worst case, to degraded estimates even compared to the no assimilation case. Model uncertainty characterization has received little attention relative to other aspects of DA science. Traditional methods rely on subjective, ad hoc tuning factors or parametric distribution assumptions that may not always be applicable. We propose a novel data-driven approach (named SDMU) to model uncertainty characterization for DA studies where (1) the system states are partially observed and (2) minimal prior knowledge of the model error processes is available, except that the errors display state dependence. It includes an approach for estimating the uncertainty in hidden model states, with the end goal of improving predictions of observed variables. The SDMU is therefore suited to DA studies where the observed variables are of primary interest. Its efficacy is demonstrated through a synthetic case study with low-dimensional chaotic dynamics and a real hydrologic experiment for one-day-ahead streamflow forecasting. In both experiments, the proposed method leads to substantial improvements in the hidden states and observed system outputs over a standard method involving perturbation with Gaussian noise.
引用
收藏
页码:1252 / 1280
页数:29
相关论文
共 50 条
  • [21] A dynamic data-driven method for dealing with model structural error in soil moisture data assimilation
    Zhang, Qiuru
    Shi, Liangsheng
    Holzman, Mauro
    Ye, Ming
    Wang, Yakun
    Carmona, Facundo
    Zha, Yuanyuan
    ADVANCES IN WATER RESOURCES, 2019, 132
  • [22] Uncertainty assessment of hydrologic model states and parameters: Sequential data assimilation using the particle filter
    Moradkhani, H
    Hsu, KL
    Gupta, H
    Sorooshian, S
    WATER RESOURCES RESEARCH, 2005, 41 (05) : 1 - 17
  • [23] Mixture Ensembles for Data Assimilation in Dynamic Data-Driven Environmental Systems
    Tagade, Piyush
    Seybold, Hansjoerg
    Ravela, Sai
    2014 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE, 2014, 29 : 1266 - 1276
  • [24] Reduction in the Amount of Data for Data-driven Passivity Estimation
    Iijima, Kanami
    Tanemura, Masaya
    Azuma, Shun-ichi
    Chida, Yuichi
    2020 IEEE CONFERENCE ON CONTROL TECHNOLOGY AND APPLICATIONS (CCTA), 2020, : 134 - 139
  • [25] A probabilistic, data-driven closure model for RANS simulations with aleatoric, model uncertainty
    Agrawal, Atul
    Koutsourelakis, Phaedon-Stelios
    JOURNAL OF COMPUTATIONAL PHYSICS, 2024, 508
  • [26] Improving Data-driven Heterogeneous Treatment Effect Estimation Under Structure Uncertainty
    Tran, Christopher
    Zheleva, Elena
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 1787 - 1797
  • [27] Data-driven estimation for multithreshold accelerated failure time model
    Wan, Chuang
    Zeng, Hao
    Zhang, Wenyang
    Zhong, Wei
    Zou, Changliang
    SCANDINAVIAN JOURNAL OF STATISTICS, 2025, 52 (01) : 447 - 468
  • [28] A Data-driven Estimation Model for Industrial Demand Flexibility Potential
    Baek, Keon
    Baek, Jun
    Ko, Kabseok
    JOURNAL OF ELECTRICAL ENGINEERING & TECHNOLOGY, 2025,
  • [29] Optimal control of an SIRD model with data-driven parameter estimation
    Khan, Md. Harun-Or-Rashid
    Ahmed, Mostak
    Sarker, M. M. Alam
    RESULTS IN CONTROL AND OPTIMIZATION, 2024, 14
  • [30] Data-driven human model estimation for realtime motion capture
    Su, Le
    Liao, Lianjun
    Zhai, Wenpeng
    Xia, Shihong
    JOURNAL OF VISUAL LANGUAGES AND COMPUTING, 2018, 48 : 10 - 18