Deep-OSG: Deep learning of operators in semigroup

被引:1
|
作者
Chen, Junfeng [1 ]
Wu, Kailiang [1 ,2 ,3 ]
机构
[1] Southern Univ Sci & Technol, Dept Math, Shenzhen 518055, Peoples R China
[2] Southern Univ Sci & Technol, SUSTech Int Ctr Math, Shenzhen 518055, Peoples R China
[3] Natl Ctr Appl Math Shenzhen NCAMS, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Neural network; Learning ODE and PDE; Operator learning; Semigroup; Flow map learning; GOVERNING EQUATIONS;
D O I
10.1016/j.jcp.2023.112498
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper proposes a novel deep learning approach for learning operators in semigroup, with applications to modeling unknown autonomous dynamical systems using time series data collected at varied time lags. It is a sequel to the previous flow map learning (FML) works [Qin et al. (2019) [29]], [Wu and Xiu (2020) [30]], and [Chen et al. (2022) [31]], which focused on learning single evolution operator with a fixed time step. This paper aims to learn a family of evolution operators with variable time steps, which constitute a semigroup for an autonomous system. The semigroup property is very crucial and links the system's evolutionary behaviors across varying time scales, but it was not considered in the previous works. We propose for the first time a framework of embedding the semigroup property into the data-driven learning process, through a novel neural network architecture and new loss functions. The framework is very feasible, can be combined with any suitable neural networks, and is applicable to learning general autonomous ODEs and PDEs. We present the rigorous error estimates and variance analysis to understand the prediction accuracy and robustness of our approach, showing the remarkable advantages of semigroup awareness in our model. Moreover, our approach allows one to arbitrarily choose the time steps for prediction and ensures that the predicted results are well selfmatched and consistent. Extensive numerical experiments demonstrate that embedding the semigroup property notably reduces the data dependency of deep learning models and greatly improves the accuracy, robustness, and stability for long-time prediction.(c) 2023 Elsevier Inc. All rights reserved.
引用
收藏
页数:33
相关论文
共 50 条
  • [31] LEARNING DEEP CLASSIFIERS WITH DEEP FEATURES
    Lei, Jie
    Song, Xinhui
    Sun, Li
    Song, Mingli
    Li, Na
    Chen, Chun
    2016 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO (ICME), 2016,
  • [32] Deep learning
    Hof, R.D., 1600, Massachusetts Institute of Technology (116):
  • [33] Deep learning
    Nicole Rusk
    Nature Methods, 2016, 13 : 35 - 35
  • [34] Deep learning
    Yann LeCun
    Yoshua Bengio
    Geoffrey Hinton
    Nature, 2015, 521 : 436 - 444
  • [35] Deep Learning
    Kim, Kwang Gi
    HEALTHCARE INFORMATICS RESEARCH, 2016, 22 (04) : 351 - 354
  • [36] Deep learning
    Rousseau, Axel-Jan
    Geubbelmans, Melvi
    Burzykowski, Tomas
    Valkenborg, Dir
    AMERICAN JOURNAL OF ORTHODONTICS AND DENTOFACIAL ORTHOPEDICS, 2024, 165 (03) : 369 - 371
  • [37] Deep learning
    LeCun, Yann
    Bengio, Yoshua
    Hinton, Geoffrey
    NATURE, 2015, 521 (7553) : 436 - 444
  • [38] Deep Learning
    不详
    TECHNOLOGY REVIEW, 2013, 116 (04) : 8 - 8
  • [39] Deep learning
    Rusk, Nicole
    NATURE METHODS, 2016, 13 (01) : 35 - 35
  • [40] Deep Learning
    Hof, Robert D.
    TECHNOLOGY REVIEW, 2013, 116 (03) : 32 - 36