Data-Driven Model Uncertainty Estimation in Hydrologic Data Assimilation

被引:73
|
作者
Pathiraja, S. [1 ,2 ]
Moradkhani, H. [3 ]
Marshall, L. [2 ]
Sharma, A. [2 ]
Geenens, G. [4 ]
机构
[1] Univ Potsdam, Inst Math, Potsdam, Germany
[2] Univ New South Wales, Sch Civil & Environm Engn, Water Res Ctr, Sydney, NSW, Australia
[3] Portland State Univ, Dept Civil & Environm Engn, Portland, OR 97207 USA
[4] Univ New South Wales, Sch Math & Stat, Sydney, NSW, Australia
基金
澳大利亚研究理事会;
关键词
data assimilation; model error; uncertainty quantification; particle filter; nonparametric statistics; SEQUENTIAL DATA ASSIMILATION; ENSEMBLE DATA ASSIMILATION; SOIL-MOISTURE; PARAMETER-ESTIMATION; PARTICLE FILTER; KALMAN FILTER; PROBABILISTIC PREDICTION; STREAMFLOW OBSERVATIONS; INITIAL CONDITION; ERROR;
D O I
10.1002/2018WR022627
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The increasing availability of earth observations necessitates mathematical methods to optimally combine such data with hydrologic models. Several algorithms exist for such purposes, under the umbrella of data assimilation (DA). However, DA methods are often applied in a suboptimal fashion for complex real-world problems, due largely to several practical implementation issues. One such issue is error characterization, which is known to be critical for a successful assimilation. Mischaracterized errors lead to suboptimal forecasts, and in the worst case, to degraded estimates even compared to the no assimilation case. Model uncertainty characterization has received little attention relative to other aspects of DA science. Traditional methods rely on subjective, ad hoc tuning factors or parametric distribution assumptions that may not always be applicable. We propose a novel data-driven approach (named SDMU) to model uncertainty characterization for DA studies where (1) the system states are partially observed and (2) minimal prior knowledge of the model error processes is available, except that the errors display state dependence. It includes an approach for estimating the uncertainty in hidden model states, with the end goal of improving predictions of observed variables. The SDMU is therefore suited to DA studies where the observed variables are of primary interest. Its efficacy is demonstrated through a synthetic case study with low-dimensional chaotic dynamics and a real hydrologic experiment for one-day-ahead streamflow forecasting. In both experiments, the proposed method leads to substantial improvements in the hidden states and observed system outputs over a standard method involving perturbation with Gaussian noise.
引用
收藏
页码:1252 / 1280
页数:29
相关论文
共 50 条
  • [41] Behavioral uncertainty quantification for data-driven control
    Padoan, Alberto
    Coulson, Jeremy
    van Waarde, Henk J.
    Lygeros, John
    Dorfler, Florian
    2022 IEEE 61ST CONFERENCE ON DECISION AND CONTROL (CDC), 2022, : 4726 - 4731
  • [42] Data-driven deep density estimation
    Patrik Puchert
    Pedro Hermosilla
    Tobias Ritschel
    Timo Ropinski
    Neural Computing and Applications, 2021, 33 : 16773 - 16807
  • [43] Data-driven remanufacturing planning with parameter uncertainty
    Zhu, Zhicheng
    Xiang, Yisha
    Zhao, Ming
    Shi, Yue
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2023, 309 (01) : 102 - 116
  • [44] A data-driven hysteresis model
    Ikhouane, Faycal
    STRUCTURAL CONTROL & HEALTH MONITORING, 2022, 29 (09):
  • [45] Modified Data-driven Power Flow Model for Power Estimation with Incomplete Bus Data
    Xing, Zheng
    Lao, Keng-Weng
    Gao, HongJun
    Dai, NingYi
    PROCEEDINGS OF 2022 12TH INTERNATIONAL CONFERENCE ON POWER, ENERGY AND ELECTRICAL ENGINEERING (CPEEE 2022), 2022, : 316 - 320
  • [46] A data-driven reflectance model
    Matusik, W
    Pfister, H
    Brand, M
    McMillan, L
    ACM TRANSACTIONS ON GRAPHICS, 2003, 22 (03): : 759 - 769
  • [47] Integrating model-driven and data-driven methods for fast state estimation
    Wu, Zhong
    Wang, Qi
    Hu, JianXiong
    Tang, Yi
    Zhang, YuNan
    INTERNATIONAL JOURNAL OF ELECTRICAL POWER & ENERGY SYSTEMS, 2022, 139
  • [48] A data assimilation framework for data-driven flow models enabled by motion tomography
    Chang, Dongsik
    Edwards, Catherine R.
    Zhang, Fumin
    Sun, Jing
    INTERNATIONAL JOURNAL OF INTELLIGENT ROBOTICS AND APPLICATIONS, 2019, 3 (02) : 158 - 177
  • [49] Data-Driven Interpolation of Sea Level Anomalies Using Analog Data Assimilation
    Lguensat, Redouane
    Phi Huynh Viet
    Sun, Miao
    Chen, Ge
    Tian Fenglin
    Chapron, Bertrand
    Fablet, Ronan
    REMOTE SENSING, 2019, 11 (07)
  • [50] A data assimilation framework for data-driven flow models enabled by motion tomography
    Dongsik Chang
    Catherine R. Edwards
    Fumin Zhang
    Jing Sun
    International Journal of Intelligent Robotics and Applications, 2019, 3 : 158 - 177