Deep-OSG: Deep learning of operators in semigroup

被引:1
|
作者
Chen, Junfeng [1 ]
Wu, Kailiang [1 ,2 ,3 ]
机构
[1] Southern Univ Sci & Technol, Dept Math, Shenzhen 518055, Peoples R China
[2] Southern Univ Sci & Technol, SUSTech Int Ctr Math, Shenzhen 518055, Peoples R China
[3] Natl Ctr Appl Math Shenzhen NCAMS, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Neural network; Learning ODE and PDE; Operator learning; Semigroup; Flow map learning; GOVERNING EQUATIONS;
D O I
10.1016/j.jcp.2023.112498
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper proposes a novel deep learning approach for learning operators in semigroup, with applications to modeling unknown autonomous dynamical systems using time series data collected at varied time lags. It is a sequel to the previous flow map learning (FML) works [Qin et al. (2019) [29]], [Wu and Xiu (2020) [30]], and [Chen et al. (2022) [31]], which focused on learning single evolution operator with a fixed time step. This paper aims to learn a family of evolution operators with variable time steps, which constitute a semigroup for an autonomous system. The semigroup property is very crucial and links the system's evolutionary behaviors across varying time scales, but it was not considered in the previous works. We propose for the first time a framework of embedding the semigroup property into the data-driven learning process, through a novel neural network architecture and new loss functions. The framework is very feasible, can be combined with any suitable neural networks, and is applicable to learning general autonomous ODEs and PDEs. We present the rigorous error estimates and variance analysis to understand the prediction accuracy and robustness of our approach, showing the remarkable advantages of semigroup awareness in our model. Moreover, our approach allows one to arbitrarily choose the time steps for prediction and ensures that the predicted results are well selfmatched and consistent. Extensive numerical experiments demonstrate that embedding the semigroup property notably reduces the data dependency of deep learning models and greatly improves the accuracy, robustness, and stability for long-time prediction.(c) 2023 Elsevier Inc. All rights reserved.
引用
收藏
页数:33
相关论文
共 50 条
  • [41] Deep Learning
    Salakhutdinov, Ruslan
    PROCEEDINGS OF THE 20TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING (KDD'14), 2014, : 1973 - 1973
  • [42] Deep learning
    Wick C.
    Informatik-Spektrum, 2017, 40 (1) : 103 - 107
  • [43] Deep Learning
    Hao, Xing
    Zhang, Guigang
    Ma, Shang
    INTERNATIONAL JOURNAL OF SEMANTIC COMPUTING, 2016, 10 (03) : 417 - 439
  • [44] Meta-learning pseudo-differential operators with deep neural networks
    ICME, Stanford University, Stanford
    CA
    94305, United States
    不详
    CA
    94305, United States
    不详
    CA
    94305, United States
    J. Comput. Phys., 2020,
  • [45] Learning Deep Neural Network Representations for Koopman Operators of Nonlinear Dynamical Systems
    Yeung, Enoch
    Kundu, Soumya
    Hodas, Nathan
    2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 4832 - 4839
  • [46] Ambiguity in Solving Imaging Inverse Problems with Deep-Learning-Based Operators
    Evangelista, Davide
    Morotti, Elena
    Piccolomini, Elena Loli
    Nagy, James
    JOURNAL OF IMAGING, 2023, 9 (07)
  • [47] Convolution Operators for Deep Learning Inference on the Fujitsu A64FX Processor
    Dolz, Manuel F.
    Martinez, Hector
    Alonso, Pedro
    Quintana-Orti, Enrique S.
    2022 IEEE 34TH INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE AND HIGH PERFORMANCE COMPUTING (SBAC-PAD 2022), 2022, : 160 - 169
  • [48] Pseudodifferential Operators Associated with a Semigroup of Operators
    Bernicot, Frederic
    Frey, Dorothee
    JOURNAL OF FOURIER ANALYSIS AND APPLICATIONS, 2014, 20 (01) : 91 - 118
  • [49] Pseudodifferential Operators Associated with a Semigroup of Operators
    Frédéric Bernicot
    Dorothee Frey
    Journal of Fourier Analysis and Applications, 2014, 20 : 91 - 118
  • [50] Meta-learning pseudo-differential operators with deep neural networks
    Feliu-Faba, Jordi
    Fan, Yuwei
    Ying, Lexing
    JOURNAL OF COMPUTATIONAL PHYSICS, 2020, 408