Loss-attentional physics-informed neural networks

被引:2
|
作者
Song, Yanjie [1 ]
Wang, He [2 ]
Yang, He [1 ]
Taccari, Maria Luisa [1 ]
Chen, Xiaohui [1 ]
机构
[1] Univ Leeds, Geomodelling & AI Ctr, Sch Civil Engn, Leeds LS2 9JT, England
[2] UCL, Dept Comp Sci, Gower St, London WC1E 6BT, England
关键词
Physics-informed neural network; Point error-based weighting method; Loss attention; Novel architecture; Neural network;
D O I
10.1016/j.jcp.2024.112781
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Physics -informed neural networks (PINNs) have emerged as a significant endeavour in recent years to utilize artificial intelligence technology for solving various partial differential equations (PDEs). Nevertheless, the vanilla PINN model structure encounters challenges in accurately approximating solutions at hard -to -fit regions with, for instance, "stiffness" points characterized by fast -paced alterations in timescale. To this end, we introduce a novel model architecture based on PINN, named loss-attentional physics -informed neural networks (LA-PINN), which equips each loss component with an independent loss-attentional network (LAN). Feeding the squared errors (������������) on every training point into LAN as the input, the attentional function is then built by each LAN and provides different weights to diverse point ������������s. A point errorbased weighting approach that utilizes the adversarial training between multiple networks in the LA-PINN model is proposed to dynamically update weights of ������������ during every training epoch. Additionally, the weighting mechanism of LA-PINN is analysed and also be validated by performing several numerical experiments. The experimental results indicate that the proposed method displays superior predictive performance compared to the vanilla PINN and holds a swift convergence characteristic. Moreover, it can advance the convergence of those hard -to -fit points by progressively increasing the growth rates of both the weight and the update gradient for point error.
引用
收藏
页数:24
相关论文
共 50 条
  • [21] Numerical analysis of physics-informed neural networks and related models in physics-informed machine learning
    De Ryck, Tim
    Mishra, Siddhartha
    [J]. ACTA NUMERICA, 2024, 33 : 633 - 713
  • [22] Is L2 Physics-Informed Loss Always Suitable for Training Physics-Informed Neural Network?
    Wang, Chuwei
    Li, Shanda
    He, Di
    Wang, Liwei
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [23] Physics-Informed Neural Networks for Cardiac Activation Mapping
    Costabal, Francisco Sahli
    Yang, Yibo
    Perdikaris, Paris
    Hurtado, Daniel E.
    Kuhl, Ellen
    [J]. FRONTIERS IN PHYSICS, 2020, 8
  • [24] Physics-Informed Neural Networks for Heat Transfer Problems
    Cai, Shengze
    Wang, Zhicheng
    Wang, Sifan
    Perdikaris, Paris
    Karniadakis, George E. M.
    [J]. JOURNAL OF HEAT TRANSFER-TRANSACTIONS OF THE ASME, 2021, 143 (06):
  • [25] Tackling the curse of dimensionality with physics-informed neural networks
    Hu, Zheyuan
    Shukla, Khemraj
    Karniadakis, George Em
    Kawaguchi, Kenji
    [J]. NEURAL NETWORKS, 2024, 176
  • [26] Design of Turing Systems with Physics-Informed Neural Networks
    Kho, Jordon
    Koh, Winston
    Wong, Jian Cheng
    Chiu, Pao-Hsiung
    Ooi, Chin Chun
    [J]. 2022 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (SSCI), 2022, : 1180 - 1186
  • [27] The application of physics-informed neural networks to hydrodynamic voltammetry
    Chen, Haotian
    Kaetelhoen, Enno
    Compton, Richard G.
    [J]. ANALYST, 2022, 147 (09) : 1881 - 1891
  • [28] Parallel Physics-Informed Neural Networks with Bidirectional Balance
    Huang, Yuhao
    Xu, Jiarong
    Fang, Shaomei
    Zhu, Zupeng
    Jiang, Linfeng
    Liang, Xiaoxin
    [J]. 6TH INTERNATIONAL CONFERENCE ON INNOVATION IN ARTIFICIAL INTELLIGENCE, ICIAI2022, 2022, : 23 - 30
  • [29] Boussinesq equation solved by the physics-informed neural networks
    Ruozhou Gao
    Wei Hu
    Jinxi Fei
    Hongyu Wu
    [J]. Nonlinear Dynamics, 2023, 111 : 15279 - 15291
  • [30] Self-adaptive physics-informed neural networks
    McClenny, Levi D.
    Braga-Neto, Ulisses M.
    [J]. JOURNAL OF COMPUTATIONAL PHYSICS, 2023, 474