Deep-OSG: Deep learning of operators in semigroup

被引:1
|
作者
Chen, Junfeng [1 ]
Wu, Kailiang [1 ,2 ,3 ]
机构
[1] Southern Univ Sci & Technol, Dept Math, Shenzhen 518055, Peoples R China
[2] Southern Univ Sci & Technol, SUSTech Int Ctr Math, Shenzhen 518055, Peoples R China
[3] Natl Ctr Appl Math Shenzhen NCAMS, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Neural network; Learning ODE and PDE; Operator learning; Semigroup; Flow map learning; GOVERNING EQUATIONS;
D O I
10.1016/j.jcp.2023.112498
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This paper proposes a novel deep learning approach for learning operators in semigroup, with applications to modeling unknown autonomous dynamical systems using time series data collected at varied time lags. It is a sequel to the previous flow map learning (FML) works [Qin et al. (2019) [29]], [Wu and Xiu (2020) [30]], and [Chen et al. (2022) [31]], which focused on learning single evolution operator with a fixed time step. This paper aims to learn a family of evolution operators with variable time steps, which constitute a semigroup for an autonomous system. The semigroup property is very crucial and links the system's evolutionary behaviors across varying time scales, but it was not considered in the previous works. We propose for the first time a framework of embedding the semigroup property into the data-driven learning process, through a novel neural network architecture and new loss functions. The framework is very feasible, can be combined with any suitable neural networks, and is applicable to learning general autonomous ODEs and PDEs. We present the rigorous error estimates and variance analysis to understand the prediction accuracy and robustness of our approach, showing the remarkable advantages of semigroup awareness in our model. Moreover, our approach allows one to arbitrarily choose the time steps for prediction and ensures that the predicted results are well selfmatched and consistent. Extensive numerical experiments demonstrate that embedding the semigroup property notably reduces the data dependency of deep learning models and greatly improves the accuracy, robustness, and stability for long-time prediction.(c) 2023 Elsevier Inc. All rights reserved.
引用
收藏
页数:33
相关论文
共 50 条
  • [1] Predoo: Precision Testing of Deep Learning Operators
    Zhang, Xufan
    Sun, Ning
    Fang, Chunrong
    Liu, Jiawei
    Liu, Jia
    Chai, Dong
    Wang, Jiang
    Chen, Zhenyu
    ISSTA '21: PROCEEDINGS OF THE 30TH ACM SIGSOFT INTERNATIONAL SYMPOSIUM ON SOFTWARE TESTING AND ANALYSIS, 2021, : 400 - 412
  • [2] Duo: Differential Fuzzing for Deep Learning Operators
    Zhang, Xufan
    Liu, Jiawei
    Sun, Ning
    Fang, Chunrong
    Liu, Jia
    Wang, Jiang
    Chai, Dong
    Chen, Zhenyu
    IEEE TRANSACTIONS ON RELIABILITY, 2021, 70 (04) : 1671 - 1685
  • [3] DLOOPT: An Optimization Assistant on AutoTVM for Deep Learning Operators
    Yu-Sheng Hsieh
    Yi-Ping You
    Journal of Signal Processing Systems, 2023, 95 : 585 - 607
  • [4] An Empirical Evaluation of Mutation Operators for Deep Learning Systems
    Jahangirova, Gunel
    Tonella, Paolo
    2020 IEEE 13TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VALIDATION AND VERIFICATION (ICST 2020), 2020, : 74 - 84
  • [5] On Non-Linear operators for Geometric Deep Learning
    Sergeant-Perthuis, Gregoire
    Maier, Jakob
    Bruna, Joan
    Oyallon, Edouard
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35, NEURIPS 2022, 2022,
  • [6] DLOOPT: An Optimization Assistant on AutoTVM for Deep Learning Operators
    Hsieh, Yu-Sheng
    You, Yi-Ping
    JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2023, 95 (05): : 585 - 607
  • [7] Deep Learning Solution of the Eigenvalue Problem for Differential Operators
    Ben-Shaul, Ido
    Bar, Leah
    Fishelov, Dalia
    Sochen, Nir
    NEURAL COMPUTATION, 2023, 35 (06) : 1100 - 1134
  • [8] Defect Detection for Deep Learning Frameworks Based on Meta Operators
    Gu D.-D.
    Shi Y.-N.
    Liu X.-Z.
    Wu G.
    Jiang H.-O.
    Zhao Y.-S.
    Ma Y.
    Jisuanji Xuebao/Chinese Journal of Computers, 2022, 45 (02): : 240 - 255
  • [9] DeltaConv: Anisotropic Operators for Geometric Deep Learning on Point Clouds
    Wiersma, Ruben
    Nasikun, Ahmad
    Eisemann, Elmar
    Hildebrandt, Klaus
    ACM TRANSACTIONS ON GRAPHICS, 2022, 41 (04):
  • [10] ACETest: Automated Constraint Extraction for Testing Deep Learning Operators
    Shi, Jingyi
    Xiao, Yang
    Li, Yuekang
    Li, Yeting
    Yu, Dongsong
    Yu, Chendong
    Su, Hui
    Chen, Yufeng
    Huo, Wei
    PROCEEDINGS OF THE 32ND ACM SIGSOFT INTERNATIONAL SYMPOSIUM ON SOFTWARE TESTING AND ANALYSIS, ISSTA 2023, 2023, : 690 - 702