DGM: A deep learning algorithm for solving partial differential equations

被引:1197
|
作者
Sirignano, Justin [1 ]
Spiliopoulos, Konstantinos [2 ]
机构
[1] Univ Illinois, Urbana, IL 61801 USA
[2] Boston Univ, Dept Math & Stat, Boston, MA 02215 USA
基金
美国国家科学基金会;
关键词
Partial differential equations; Machine learning; Deep learning; High-dimensional partial differential equations; NONLINEAR PARABOLIC EQUATIONS; AMERICAN OPTIONS; NEURAL-NETWORKS; APPROXIMATION; EXISTENCE; CONVERGENCE; NOISE;
D O I
10.1016/j.jcp.2018.08.029
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
High-dimensional PDEs have been a longstanding computational challenge. We propose to solve high-dimensional PDEs by approximating the solution with a deep neural network which is trained to satisfy the differential operator, initial condition, and boundary conditions. Our algorithm is meshfree, which is key since meshes become infeasible in higher dimensions. Instead of forming a mesh, the neural network is trained on batches of randomly sampled time and space points. The algorithm is tested on a class of high-dimensional free boundary PDEs, which we are able to accurately solve in up to 200 dimensions. The algorithm is also tested on a high-dimensional Hamilton-Jacobi-Bellman PDE and Burgers' equation. The deep learning algorithm approximates the general solution to the Burgers' equation for a continuum of different boundary conditions and physical conditions (which can be viewed as a high-dimensional space). We call the algorithm a "Deep Galerkin Method (DGM)" since it is similar in spirit to Galerkin methods, with the solution approximated by a neural network instead of a linear combination of basis functions. In addition, we prove a theorem regarding the approximation power of neural networks for a class of quasilinear parabolic PDEs. (C) 2018 Elsevier Inc. All rights reserved.
引用
收藏
页码:1339 / 1364
页数:26
相关论文
共 50 条
  • [31] Solving differential equations with deep learning: a beginner's guide
    Navarro, Luis Medrano
    Martin-Moreno, Luis
    Rodrigo, Sergio G.
    EUROPEAN JOURNAL OF PHYSICS, 2024, 45 (01)
  • [32] Extreme Learning Machine with Kernels for Solving Elliptic Partial Differential Equations
    Shaohong Li
    Guoguo Liu
    Shiguo Xiao
    Cognitive Computation, 2023, 15 : 413 - 428
  • [33] Extreme Learning Machine with Kernels for Solving Elliptic Partial Differential Equations
    Li, Shaohong
    Liu, Guoguo
    Xiao, Shiguo
    COGNITIVE COMPUTATION, 2023, 15 (02) : 413 - 428
  • [34] Numerically Solving Parametric Families of High-Dimensional Kolmogorov Partial Differential Equations via Deep Learning
    Berner, Julius
    Dablander, Markus
    Grohs, Philipp
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [35] Multi-level physics informed deep learning for solving partial differential equations in computational structural mechanics
    Weiwei He
    Jinzhao Li
    Xuan Kong
    Lu Deng
    Communications Engineering, 3 (1):
  • [36] Improved Deep Neural Networks with Domain Decomposition in Solving Partial Differential Equations
    Wei Wu
    Xinlong Feng
    Hui Xu
    Journal of Scientific Computing, 2022, 93
  • [37] Improved Deep Neural Networks with Domain Decomposition in Solving Partial Differential Equations
    Wu, Wei
    Feng, Xinlong
    Xu, Hui
    JOURNAL OF SCIENTIFIC COMPUTING, 2022, 93 (01)
  • [38] Neural network algorithm based on Legendre improved extreme learning machine for solving elliptic partial differential equations
    Yunlei Yang
    Muzhou Hou
    Hongli Sun
    Tianle Zhang
    Futian Weng
    Jianshu Luo
    Soft Computing, 2020, 24 : 1083 - 1096
  • [39] Neural network algorithm based on Legendre improved extreme learning machine for solving elliptic partial differential equations
    Yang, Yunlei
    Hou, Muzhou
    Sun, Hongli
    Zhang, Tianle
    Weng, Futian
    Luo, Jianshu
    SOFT COMPUTING, 2020, 24 (02) : 1083 - 1096
  • [40] Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations
    Raissi, Maziar
    JOURNAL OF MACHINE LEARNING RESEARCH, 2018, 19