Gradient-optimized physics-informed neural networks (GOPINNs): a deep learning method for solving the complex modified KdV equation

被引:57
|
作者
Li, Jiaheng [1 ]
Chen, Junchao [2 ,3 ]
Li, Biao [1 ]
机构
[1] Ningbo Univ, Sch Math & Stat, Ningbo 315211, Peoples R China
[2] Lishui Univ, Dept Math, Lishui 323000, Peoples R China
[3] Lishui Univ, Inst Nonlinear Anal, Lishui 323000, Peoples R China
基金
中国国家自然科学基金;
关键词
Physics-informed neural networks; Gradient optimization; Complex modified KdV equation; Rational wave solution; Soliton molecules solution; MODELS;
D O I
10.1007/s11071-021-06996-x
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
Recently, the physics-informed neural networks (PINNs) have received more and more attention because of their ability to solve nonlinear partial differential equations via only a small amount of data to quickly obtain data-driven solutions with high accuracy. However, despite their remarkable promise in the early stage, their unbalanced back-propagation gradient calculation leads to drastic oscillations in the gradient value during model training, which is prone to unstable prediction accuracy. Based on this, we develop a gradient optimization algorithm, which proposes a new neural network structure and balances the interaction between different terms in the loss function during model training by means of gradient statistics, so that the newly proposed network architecture is more robust to gradient fluctuations. In this paper, we take the complex modified KdV equation as an example and use the gradient-optimized PINNs (GOPINNs) deep learning method to obtain data-driven rational wave solution and soliton molecules solution. Numerical results show that the GOPINNs method effectively smooths the gradient fluctuations and reproduces the dynamic behavior of these data-driven solutions better than the original PINNs method. In summary, our work provides new insights for optimizing the learning performance of neural networks and improves the prediction accuracy by a factor of 10 to 30 when solving the complex modified KdV equation.
引用
收藏
页码:781 / 792
页数:12
相关论文
共 50 条
  • [31] Learning in sinusoidal spaces with physics-informed neural networks
    Wong J.C.
    Ooi C.C.
    Gupta A.
    Ong Y.S.
    IEEE Transactions on Artificial Intelligence, 2024, 5 (03): : 985 - 1000
  • [32] A deep learning method for multi-material diffusion problems based on physics-informed neural networks
    Yao, Yanzhong
    Guo, Jiawei
    Gu, Tongxiang
    COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2023, 417
  • [33] Physics-informed neural networks for the Reynolds equation with cavitation modeling
    Rom, Michael
    TRIBOLOGY INTERNATIONAL, 2023, 179
  • [34] A General Method for Solving Differential Equations of Motion Using Physics-Informed Neural Networks
    Zhang, Wenhao
    Ni, Pinghe
    Zhao, Mi
    Du, Xiuli
    APPLIED SCIENCES-BASEL, 2024, 14 (17):
  • [35] Gradient auxiliary physics-informed neural network for nonlinear biharmonic equation
    Liu, Yu
    Ma, Wentao
    ENGINEERING ANALYSIS WITH BOUNDARY ELEMENTS, 2023, 157 : 272 - 282
  • [36] A novel meta-learning initialization method for physics-informed neural networks
    Liu, Xu
    Zhang, Xiaoya
    Peng, Wei
    Zhou, Weien
    Yao, Wen
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (17): : 14511 - 14534
  • [37] A novel meta-learning initialization method for physics-informed neural networks
    Xu Liu
    Xiaoya Zhang
    Wei Peng
    Weien Zhou
    Wen Yao
    Neural Computing and Applications, 2022, 34 : 14511 - 14534
  • [38] Physics-Informed Deep Neural Networks for Transient Electromagnetic Analysis
    Noakoasteen, Oameed
    Wang, Shu
    Peng, Zhen
    Christodoulou, Christos
    IEEE OPEN JOURNAL OF ANTENNAS AND PROPAGATION, 2020, 1 (01): : 404 - 412
  • [39] Deep NURBS-admissible physics-informed neural networks
    Saidaoui, Hamed
    Espath, Luis
    Tempone, Raul
    ENGINEERING WITH COMPUTERS, 2024, 40 (06) : 4007 - 4021
  • [40] An adaptive discrete physics-informed neural network method for solving the Cahn-Hilliard equation
    He, Jian
    Li, Xinxiang
    Zhu, Huiqing
    ENGINEERING ANALYSIS WITH BOUNDARY ELEMENTS, 2023, 155 : 826 - 838