EXTRACTING SPARSE HIGH-DIMENSIONAL DYNAMICS FROM LIMITED DATA

被引:90
|
作者
Schaeffer, Hayden [1 ]
Tran, Giang [2 ]
Ward, Rachel [3 ]
机构
[1] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
[2] Univ Waterloo, Dept Appl Math, Waterloo, ON N2L 3G1, Canada
[3] Univ Texas Austin, Austin, TX 78712 USA
基金
加拿大自然科学与工程研究理事会; 美国国家科学基金会;
关键词
high-dimensional dynamical systems; sparse optimization; model selection; exact recovery; undersampled data; chaos; MODE DECOMPOSITION; CHAOS; EQUATIONS;
D O I
10.1137/18M116798X
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Extracting governing equations from dynamic data is an essential task in model selection and parameter estimation. The form of the governing equation is rarely known a priori; however, based on the sparsity-of-effect principle one may assume that the number of candidate functions needed to represent the dynamics is very small. In this work, we leverage the sparse structure of the governing equations along with recent results from random sampling theory to develop methods for selecting dynamical systems from undersampled data. In particular, we detail three sampling strategies that lead to the exact recovery of first-order dynamical systems when we are given fewer samples than unknowns. The first method makes no assumptions on the behavior of the data, and requires a certain number of random initial samples. The second method utilizes the structure of the governing equation to limit the number of random initializations needed. The third method leverages chaotic behavior in the data to construct a nearly deterministic sampling strategy. Using results from compressive sensing, we show that the strategies lead to exact recovery, which is stable to the sparse structure of the governing equations and robust to noise in the estimation of the velocity. Computational results validate each of the sampling strategies and highlight potential applications.
引用
收藏
页码:3279 / 3295
页数:17
相关论文
共 50 条
  • [31] Market segmentation using high-dimensional sparse consumers data
    Zhou, Jian
    Zhai, Linli
    Pantelous, Athanasios A.
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2020, 145 (145)
  • [32] Sparse boosting for high-dimensional survival data with varying coefficients
    Yue, Mu
    Li, Jialiang
    Ma, Shuangge
    [J]. STATISTICS IN MEDICINE, 2018, 37 (05) : 789 - 800
  • [33] MINIMAX BOUNDS FOR SPARSE PCA WITH NOISY HIGH-DIMENSIONAL DATA
    Birnbaum, Aharon
    Johnstone, Iain M.
    Nadler, Boaz
    Paul, Debashis
    [J]. ANNALS OF STATISTICS, 2013, 41 (03): : 1055 - 1084
  • [34] A sparse factor model for clustering high-dimensional longitudinal data
    Lu, Zihang
    Chandra, Noirrit Kiran
    [J]. STATISTICS IN MEDICINE, 2024, 43 (19) : 3633 - 3648
  • [35] Sparse representation approaches for the classification of high-dimensional biological data
    Li, Yifeng
    Ngom, Alioune
    [J]. BMC SYSTEMS BIOLOGY, 2013, 7
  • [36] On the challenges of learning with inference networks on sparse, high-dimensional data
    Krishnan, Rahul G.
    Liang, Dawen
    Hoffman, Matthew D.
    [J]. INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 84, 2018, 84
  • [37] SS/OSF for high-dimensional sparse data object clustering
    Wu, Ping
    Song, Han-Tao
    Niu, Zhen-Dong
    Zhang, Li-Ping
    Zhang, Ju-Li
    [J]. Beijing Ligong Daxue Xuebao/Transaction of Beijing Institute of Technology, 2006, 26 (03): : 216 - 220
  • [38] CLASSIFICATION OF HIGH-DIMENSIONAL DATA USING THE SPARSE MATRIX TRANSFORM
    Bachega, Leonardo R. |
    Bouman, Charles A.
    [J]. 2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 265 - 268
  • [39] Discriminant analysis of high-dimensional data over limited samples
    Serdobolskii, V. I.
    [J]. DOKLADY MATHEMATICS, 2010, 81 (01) : 75 - 77
  • [40] Discriminant analysis of high-dimensional data over limited samples
    V. I. Serdobolskii
    [J]. Doklady Mathematics, 2010, 81 : 75 - 77