Deep-OSG: Deep learning of operators in semigroup

被引:1
|
作者
Chen, Junfeng [1 ]
Wu, Kailiang [1 ,2 ,3 ]
机构
[1] Southern Univ Sci & Technol, Dept Math, Shenzhen 518055, Peoples R China
[2] Southern Univ Sci & Technol, SUSTech Int Ctr Math, Shenzhen 518055, Peoples R China
[3] Natl Ctr Appl Math Shenzhen NCAMS, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Neural network; Learning ODE and PDE; Operator learning; Semigroup; Flow map learning; GOVERNING EQUATIONS;
D O I
10.1016/j.jcp.2023.112498
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper proposes a novel deep learning approach for learning operators in semigroup, with applications to modeling unknown autonomous dynamical systems using time series data collected at varied time lags. It is a sequel to the previous flow map learning (FML) works [Qin et al. (2019) [29]], [Wu and Xiu (2020) [30]], and [Chen et al. (2022) [31]], which focused on learning single evolution operator with a fixed time step. This paper aims to learn a family of evolution operators with variable time steps, which constitute a semigroup for an autonomous system. The semigroup property is very crucial and links the system's evolutionary behaviors across varying time scales, but it was not considered in the previous works. We propose for the first time a framework of embedding the semigroup property into the data-driven learning process, through a novel neural network architecture and new loss functions. The framework is very feasible, can be combined with any suitable neural networks, and is applicable to learning general autonomous ODEs and PDEs. We present the rigorous error estimates and variance analysis to understand the prediction accuracy and robustness of our approach, showing the remarkable advantages of semigroup awareness in our model. Moreover, our approach allows one to arbitrarily choose the time steps for prediction and ensures that the predicted results are well selfmatched and consistent. Extensive numerical experiments demonstrate that embedding the semigroup property notably reduces the data dependency of deep learning models and greatly improves the accuracy, robustness, and stability for long-time prediction.(c) 2023 Elsevier Inc. All rights reserved.
引用
收藏
页数:33
相关论文
共 50 条
  • [21] Learning stiff chemical kinetics using extended deep neural operators
    Goswami, Somdatta
    Jagtap, Ameya D.
    Babaee, Hessam
    Susi, Bryan T.
    Karniadakis, George Em
    Computer Methods in Applied Mechanics and Engineering, 2024, 419
  • [22] Bridging Hydrological Ensemble Simulation and Learning Using Deep Neural Operators
    Sun, Alexander Y.
    Jiang, Peishi
    Shuai, Pin
    Chen, Xingyuan
    WATER RESOURCES RESEARCH, 2024, 60 (10)
  • [23] Optimizing GPU Deep Learning Operators with Polyhedral Scheduling Constraint Injection
    Bastoul, Cedric
    Zhang, Zhen
    Razanajato, Harenome
    Lossing, Nelson
    Susungi, Adilla
    de Juan, Javier
    Filhol, Etienne
    Jarry, Baptiste
    Consolaro, Gianpietro
    Zhang, Renwei
    CGO '22: PROCEEDINGS OF THE 2022 IEEE/ACM INTERNATIONAL SYMPOSIUM ON CODE GENERATION AND OPTIMIZATION (CGO), 2022, : 313 - 324
  • [24] PRIVACY-PRESERVING DEEP LEARNING USING DEFORMABLE OPERATORS FOR SECURE TASK LEARNING
    Perez, Fabian
    Lopez, Jhon
    Arguello, Henry
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 5980 - 5984
  • [25] Deep Lake: a Lakehouse for Deep Learning
    Hambardzumyan, Sasun
    Tuli, Abhinav
    Ghukasyan, Levon
    Rahman, Fariz
    Topchyan, Hrant
    Isayan, David
    McQuade, Mark
    Harutyunyan, Mikayel
    Hakobyan, Tatevik
    Stranic, Ivo
    Buniatyan, Davit
    arXiv, 2022,
  • [26] Facebook Deep learning= Deep Attentioning
    肖婧
    商学院, 2015, (01) : 60 - 61
  • [27] Deep Belief Networks and Deep Learning
    Hua, Yuming
    Guo, Junhai
    Zhao, Hua
    PROCEEDINGS OF 2015 INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND INTERNET OF THINGS, 2015, : 1 - 4
  • [28] Deep learning for finance: deep portfolios
    Heaton, J. B.
    Polson, N. G.
    Witte, J. H.
    APPLIED STOCHASTIC MODELS IN BUSINESS AND INDUSTRY, 2017, 33 (01) : 3 - 12
  • [29] From Deep Learning to Deep Reasoning
    Truyen Tran
    Vuong Le
    Le, Hung
    Le, Thao M.
    KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 4076 - 4077
  • [30] Learn deep before deep learning
    Mayorga, Karina Martinez
    Gomez Jimenez, Gabriela
    Madariaga-Mazon, Abraham
    ABSTRACTS OF PAPERS OF THE AMERICAN CHEMICAL SOCIETY, 2019, 257