Loss-attentional physics-informed neural networks

被引:2
|
作者
Song, Yanjie [1 ]
Wang, He [2 ]
Yang, He [1 ]
Taccari, Maria Luisa [1 ]
Chen, Xiaohui [1 ]
机构
[1] Univ Leeds, Geomodelling & AI Ctr, Sch Civil Engn, Leeds LS2 9JT, England
[2] UCL, Dept Comp Sci, Gower St, London WC1E 6BT, England
关键词
Physics-informed neural network; Point error-based weighting method; Loss attention; Novel architecture; Neural network;
D O I
10.1016/j.jcp.2024.112781
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Physics -informed neural networks (PINNs) have emerged as a significant endeavour in recent years to utilize artificial intelligence technology for solving various partial differential equations (PDEs). Nevertheless, the vanilla PINN model structure encounters challenges in accurately approximating solutions at hard -to -fit regions with, for instance, "stiffness" points characterized by fast -paced alterations in timescale. To this end, we introduce a novel model architecture based on PINN, named loss-attentional physics -informed neural networks (LA-PINN), which equips each loss component with an independent loss-attentional network (LAN). Feeding the squared errors (������������) on every training point into LAN as the input, the attentional function is then built by each LAN and provides different weights to diverse point ������������s. A point errorbased weighting approach that utilizes the adversarial training between multiple networks in the LA-PINN model is proposed to dynamically update weights of ������������ during every training epoch. Additionally, the weighting mechanism of LA-PINN is analysed and also be validated by performing several numerical experiments. The experimental results indicate that the proposed method displays superior predictive performance compared to the vanilla PINN and holds a swift convergence characteristic. Moreover, it can advance the convergence of those hard -to -fit points by progressively increasing the growth rates of both the weight and the update gradient for point error.
引用
收藏
页数:24
相关论文
共 50 条
  • [1] Temporal consistency loss for physics-informed neural networks
    Thakur, Sukirt
    Raissi, Maziar
    Mitra, Harsa
    Ardekani, Arezoo M.
    [J]. PHYSICS OF FLUIDS, 2024, 36 (07)
  • [2] Physics-informed neural networks based cascade loss model
    Feng, Yunyang
    Song, Xizhen
    Yuan, Wei
    Lu, Hanan
    [J]. Hangkong Dongli Xuebao/Journal of Aerospace Power, 2023, 38 (07): : 845 - 855
  • [3] Enforcing Dirichlet boundary conditions in physics-informed neural networks and variational physics-informed neural networks
    Berrone, S.
    Canuto, C.
    Pintore, M.
    Sukumar, N.
    [J]. HELIYON, 2023, 9 (08)
  • [4] Separable Physics-Informed Neural Networks
    Cho, Junwoo
    Nam, Seungtae
    Yang, Hyunmo
    Yun, Seok-Bae
    Hong, Youngjoon
    Park, Eunbyung
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [5] Quantum Physics-Informed Neural Networks
    Trahan, Corey
    Loveland, Mark
    Dent, Samuel
    [J]. ENTROPY, 2024, 26 (08)
  • [6] Self-adaptive loss balanced Physics-informed neural networks
    Xiang, Zixue
    Peng, Wei
    Liu, Xu
    Yao, Wen
    [J]. NEUROCOMPUTING, 2022, 496 : 11 - 34
  • [7] SOBOLEV TRAINING FOR PHYSICS-INFORMED NEURAL NETWORKS
    Son, Hwijae
    Jang, Jin woo
    Han, Woo jin
    Hwang, Hyung ju
    [J]. COMMUNICATIONS IN MATHEMATICAL SCIENCES, 2023, 21 (06) : 1679 - 1705
  • [8] Enhanced physics-informed neural networks for hyperelasticity
    Abueidda, Diab W.
    Koric, Seid
    Guleryuz, Erman
    Sobh, Nahil A.
    [J]. INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN ENGINEERING, 2023, 124 (07) : 1585 - 1601
  • [9] Physics-informed neural networks for diffraction tomography
    Saba, Amirhossein
    Gigli, Carlo
    Ayoub, Ahmed B.
    Psaltis, Demetri
    [J]. ADVANCED PHOTONICS, 2022, 4 (06):
  • [10] Physics-informed neural networks for consolidation of soils
    Zhang, Sheng
    Lan, Peng
    Li, Hai-Chao
    Tong, Chen-Xi
    Sheng, Daichao
    [J]. ENGINEERING COMPUTATIONS, 2022, 39 (07) : 2845 - 2865