EXTRACTING SPARSE HIGH-DIMENSIONAL DYNAMICS FROM LIMITED DATA

被引:90
|
作者
Schaeffer, Hayden [1 ]
Tran, Giang [2 ]
Ward, Rachel [3 ]
机构
[1] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
[2] Univ Waterloo, Dept Appl Math, Waterloo, ON N2L 3G1, Canada
[3] Univ Texas Austin, Austin, TX 78712 USA
基金
加拿大自然科学与工程研究理事会; 美国国家科学基金会;
关键词
high-dimensional dynamical systems; sparse optimization; model selection; exact recovery; undersampled data; chaos; MODE DECOMPOSITION; CHAOS; EQUATIONS;
D O I
10.1137/18M116798X
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
Extracting governing equations from dynamic data is an essential task in model selection and parameter estimation. The form of the governing equation is rarely known a priori; however, based on the sparsity-of-effect principle one may assume that the number of candidate functions needed to represent the dynamics is very small. In this work, we leverage the sparse structure of the governing equations along with recent results from random sampling theory to develop methods for selecting dynamical systems from undersampled data. In particular, we detail three sampling strategies that lead to the exact recovery of first-order dynamical systems when we are given fewer samples than unknowns. The first method makes no assumptions on the behavior of the data, and requires a certain number of random initial samples. The second method utilizes the structure of the governing equation to limit the number of random initializations needed. The third method leverages chaotic behavior in the data to construct a nearly deterministic sampling strategy. Using results from compressive sensing, we show that the strategies lead to exact recovery, which is stable to the sparse structure of the governing equations and robust to noise in the estimation of the velocity. Computational results validate each of the sampling strategies and highlight potential applications.
引用
收藏
页码:3279 / 3295
页数:17
相关论文
共 50 条
  • [1] Extracting biology from high-dimensional biological data
    Quackenbush, John
    [J]. JOURNAL OF EXPERIMENTAL BIOLOGY, 2007, 210 (09): : 1507 - 1517
  • [2] On the anonymization of sparse high-dimensional data
    Ghinita, Gabriel
    Tao, Yufei
    Kalnis, Panos
    [J]. 2008 IEEE 24TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING, VOLS 1-3, 2008, : 715 - +
  • [3] Interpolation of sparse high-dimensional data
    Lux, Thomas C. H.
    Watson, Layne T.
    Chang, Tyler H.
    Hong, Yili
    Cameron, Kirk
    [J]. NUMERICAL ALGORITHMS, 2021, 88 (01) : 281 - 313
  • [4] Interpolation of sparse high-dimensional data
    Thomas C. H. Lux
    Layne T. Watson
    Tyler H. Chang
    Yili Hong
    Kirk Cameron
    [J]. Numerical Algorithms, 2021, 88 : 281 - 313
  • [5] Extracting a cellular hierarchy from high-dimensional cytometry data with SPADE
    Qiu, Peng
    Simonds, Erin F.
    Bendall, Sean C.
    Gibbs, Kenneth D., Jr.
    Bruggner, Robert V.
    Linderman, Michael D.
    Sachs, Karen
    Nolan, Garry P.
    Plevritis, Sylvia K.
    [J]. NATURE BIOTECHNOLOGY, 2011, 29 (10) : 886 - U181
  • [6] Extracting a cellular hierarchy from high-dimensional cytometry data with SPADE
    Peng Qiu
    Erin F Simonds
    Sean C Bendall
    Kenneth D Gibbs
    Robert V Bruggner
    Michael D Linderman
    Karen Sachs
    Garry P Nolan
    Sylvia K Plevritis
    [J]. Nature Biotechnology, 2011, 29 : 886 - 891
  • [7] PCA learning for sparse high-dimensional data
    Hoyle, DC
    Rattray, M
    [J]. EUROPHYSICS LETTERS, 2003, 62 (01): : 117 - 123
  • [8] Group Learning for High-Dimensional Sparse Data
    Cherkassky, Vladimir
    Chen, Hsiang-Han
    Shiao, Han-Tai
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [9] Sparse PCA for High-Dimensional Data With Outliers
    Hubert, Mia
    Reynkens, Tom
    Schmitt, Eric
    Verdonck, Tim
    [J]. TECHNOMETRICS, 2016, 58 (04) : 424 - 434
  • [10] Similarity Learning for High-Dimensional Sparse Data
    Liu, Kuan
    Bellet, Aurelien
    Sha, Fei
    [J]. ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 38, 2015, 38 : 653 - 662