Computing high-dimensional invariant distributions from noisy data

被引:2
|
作者
Lin, Bo [1 ]
Li, Qianxiao [1 ,2 ]
Ren, Weiqing [1 ]
机构
[1] Natl Univ Singapore, Dept Math, 10 Lower Kent Ridge Rd, Singapore 119076, Singapore
[2] Natl Univ Singapore, Inst Funct Intelligent Mat, 4 Sci Dr 2, Singapore 117544, Singapore
基金
新加坡国家研究基金会;
关键词
Fokker -Planck equation; Invariant distribution; Noisy data; Maximum likelihood method; LANDSCAPE; NETWORK;
D O I
10.1016/j.jcp.2022.111783
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The invariant distribution is an important object in the study of randomly perturbed dynamical systems. The existing methods, including traditional finite difference or finite element methods as well as recently developed machine learning-based methods, all require the knowledge of the dynamical equations or adequate equilibrium data for estimating the invariant distribution. In this work, we propose a data-driven method for inferring the dynamics and simultaneously learning the invariant distribution from noisy trajectory data of the dynamical system. The data is not necessarily at equilibrium and may be collected from the transient period of the dynamics. The proposed method combines the idea of maximum likelihood estimation and a decomposition of the force field as suggested by the Fokker-Planck equation. The drift term (or force field), which is in the form of a decomposition with the constraint specified by the Fokker-Planck equation, and the diffusion term are learned from the data using an alternate updating algorithm. The generalized potential, which is the negative logarithm of the invariant distribution multiplied by the noise, is then obtained from the potential part of the decomposition. The proposed method is able to deal with high-dimensional dynamical systems and the small noise regime, without prior knowledge of the dynamical equations. The proposed method is demonstrated by four numerical examples, including a practical 10-dimensional biological network model.(c) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Clustering High-Dimensional Noisy Categorical Data
    Tian, Zhiyi
    Xu, Jiaming
    Tang, Jen
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2024,
  • [2] Geometric classifiers for high-dimensional noisy data
    Ishii, Aki
    Yata, Kazuyoshi
    Aoshima, Makoto
    [J]. JOURNAL OF MULTIVARIATE ANALYSIS, 2022, 188
  • [3] ON THE CONDITIONAL DISTRIBUTIONS OF LOW-DIMENSIONAL PROJECTIONS FROM HIGH-DIMENSIONAL DATA
    Leeb, Hannes
    [J]. ANNALS OF STATISTICS, 2013, 41 (02): : 464 - 483
  • [4] High-dimensional data acquisition, computing, and visualization
    Chen, JX
    Nakano, A
    [J]. COMPUTING IN SCIENCE & ENGINEERING, 2003, 5 (02) : 12 - 13
  • [5] Deep kernel learning of dynamical models from high-dimensional noisy data
    Nicolò Botteghi
    Mengwu Guo
    Christoph Brune
    [J]. Scientific Reports, 12
  • [6] Deep kernel learning of dynamical models from high-dimensional noisy data
    Botteghi, Nicolo
    Guo, Mengwu
    Brune, Christoph
    [J]. SCIENTIFIC REPORTS, 2022, 12 (01)
  • [7] A Robust Supervised Variable Selection for Noisy High-Dimensional Data
    Kalina, Jan
    Schlenker, Anna
    [J]. BIOMED RESEARCH INTERNATIONAL, 2015, 2015
  • [8] MINIMAX BOUNDS FOR SPARSE PCA WITH NOISY HIGH-DIMENSIONAL DATA
    Birnbaum, Aharon
    Johnstone, Iain M.
    Nadler, Boaz
    Paul, Debashis
    [J]. ANNALS OF STATISTICS, 2013, 41 (03): : 1055 - 1084
  • [9] Model selection in high-dimensional noisy data: a simulation study
    Romeo, Giovanni
    Thoresen, Magne
    [J]. JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2019, 89 (11) : 2031 - 2050
  • [10] LEARNING FROM HIGH-DIMENSIONAL NOISY DATA VIA PROJECTIONS ONTO MULTI-DIMENSIONAL ELLIPSOIDS
    Gong, Liuling
    Schonfeld, Dan
    [J]. 2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, : 1970 - 1973