Loss-attentional physics-informed neural networks

被引:2
|
作者
Song, Yanjie [1 ]
Wang, He [2 ]
Yang, He [1 ]
Taccari, Maria Luisa [1 ]
Chen, Xiaohui [1 ]
机构
[1] Univ Leeds, Geomodelling & AI Ctr, Sch Civil Engn, Leeds LS2 9JT, England
[2] UCL, Dept Comp Sci, Gower St, London WC1E 6BT, England
关键词
Physics-informed neural network; Point error-based weighting method; Loss attention; Novel architecture; Neural network;
D O I
10.1016/j.jcp.2024.112781
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Physics -informed neural networks (PINNs) have emerged as a significant endeavour in recent years to utilize artificial intelligence technology for solving various partial differential equations (PDEs). Nevertheless, the vanilla PINN model structure encounters challenges in accurately approximating solutions at hard -to -fit regions with, for instance, "stiffness" points characterized by fast -paced alterations in timescale. To this end, we introduce a novel model architecture based on PINN, named loss-attentional physics -informed neural networks (LA-PINN), which equips each loss component with an independent loss-attentional network (LAN). Feeding the squared errors (������������) on every training point into LAN as the input, the attentional function is then built by each LAN and provides different weights to diverse point ������������s. A point errorbased weighting approach that utilizes the adversarial training between multiple networks in the LA-PINN model is proposed to dynamically update weights of ������������ during every training epoch. Additionally, the weighting mechanism of LA-PINN is analysed and also be validated by performing several numerical experiments. The experimental results indicate that the proposed method displays superior predictive performance compared to the vanilla PINN and holds a swift convergence characteristic. Moreover, it can advance the convergence of those hard -to -fit points by progressively increasing the growth rates of both the weight and the update gradient for point error.
引用
收藏
页数:24
相关论文
共 50 条
  • [41] Self-Adaptive Physics-Informed Neural Networks
    Texas A&M University, United States
    [J]. 1600,
  • [42] Stiff-PDEs and Physics-Informed Neural Networks
    Prakhar Sharma
    Llion Evans
    Michelle Tindall
    Perumal Nithiarasu
    [J]. Archives of Computational Methods in Engineering, 2023, 30 (5) : 2929 - 2958
  • [43] Optimal Architecture Discovery for Physics-Informed Neural Networks
    de Wolff, Taco
    Carrillo, Hugo
    Marti, Luis
    Sanchez-Pi, Nayat
    [J]. ADVANCES IN ARTIFICIAL INTELLIGENCE-IBERAMIA 2022, 2022, 13788 : 77 - 88
  • [44] Physics-Informed Neural Networks for Quantum Eigenvalue Problems
    Jin, Henry
    Mattheakis, Marios
    Protopapas, Pavlos
    [J]. 2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [45] Discontinuity Computing Using Physics-Informed Neural Networks
    Li Liu
    Shengping Liu
    Hui Xie
    Fansheng Xiong
    Tengchao Yu
    Mengjuan Xiao
    Lufeng Liu
    Heng Yong
    [J]. Journal of Scientific Computing, 2024, 98
  • [46] Physics-informed neural networks for modeling astrophysical shocks
    Moschou, S. P.
    Hicks, E.
    Parekh, R. Y.
    Mathew, D.
    Majumdar, S.
    Vlahakis, N.
    [J]. MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2023, 4 (03):
  • [47] Physics-Informed Neural Networks with skip connections for modeling and
    Kittelsen, Jonas Ekeland
    Antonelo, Eric Aislan
    Camponogara, Eduardo
    Imsland, Lars Struen
    [J]. APPLIED SOFT COMPUTING, 2024, 158
  • [48] Adaptive task decomposition physics-informed neural networks
    Yang, Jianchuan
    Liu, Xuanqi
    Diao, Yu
    Chen, Xi
    Hu, Haikuo
    [J]. COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2024, 418
  • [49] Discontinuity Computing Using Physics-Informed Neural Networks
    Liu, Li
    Liu, Shengping
    Xie, Hui
    Xiong, Fansheng
    Yu, Tengchao
    Xiao, Mengjuan
    Liu, Lufeng
    Yong, Heng
    [J]. JOURNAL OF SCIENTIFIC COMPUTING, 2024, 98 (01)
  • [50] Scalable algorithms for physics-informed neural and graph networks
    Shukla, Khemraj
    Xu, Mengjia
    Trask, Nathaniel
    Karniadakis, George E.
    [J]. DATA-CENTRIC ENGINEERING, 2022, 3