Spiking Physics-Informed Neural Networks on Loihi 2

被引:0
|
作者
Theilman, Bradley H. [1 ]
Zhang, Qian [2 ]
Kahana, Adar [2 ]
Cyr, Eric C. [3 ]
Trask, Nathaniel [4 ]
Aimone, James B. [1 ]
Karniadakis, George Em [5 ]
机构
[1] Sandia Natl Labs, Neural Explorat & Res Lab, POB 5800, Albuquerque, NM 87185 USA
[2] Brown Univ, Div Appl Math, Providence, RI 02912 USA
[3] Sandia Natl Labs, Computat Math, POB 5800, Albuquerque, NM 87185 USA
[4] Univ Penn, Mech Engn & Appl Mech, Philadelphia, PA 19104 USA
[5] Brown Univ, Div Appl Math & Engn, Providence, RI 02912 USA
关键词
Spiking Neural Networks; Physics Informed Neural Networks; Neuromorphic Computing; Quantization; Conversion;
D O I
10.1109/NICE61972.2024.10548180
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neuromorphic computing platforms hold the promise to dramatically reduce power requirements for calculations that are computationally intensive. One such application space is scientific machine learning (SciML). Techniques in this space use neural networks to approximate solutions of scientific problems. For instance, the popular physics-informed neural network (PINN) approximates the solution to a partial differential equation by using a trained feed-forward neural network, and injecting the knowledge of the physics through the loss function. Recent efforts have demonstrated how to convert a trained PINN to a spiking network architecture. In this work, we discuss our approach to quantization and implementation required to migrate these spiking PINNs to Intel's Loihi 2 neuromorphic hardware. We explore the effect of quantization on the model accuracy, as well as the energy and throughput characteristics of the implementation. It is our intent that this serve as a starting point for additional SciML implementations on neuromorphic hardware.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Enforcing Dirichlet boundary conditions in physics-informed neural networks and variational physics-informed neural networks
    Berrone, S.
    Canuto, C.
    Pintore, M.
    Sukumar, N.
    [J]. HELIYON, 2023, 9 (08)
  • [2] Separable Physics-Informed Neural Networks
    Cho, Junwoo
    Nam, Seungtae
    Yang, Hyunmo
    Yun, Seok-Bae
    Hong, Youngjoon
    Park, Eunbyung
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [3] Quantum Physics-Informed Neural Networks
    Trahan, Corey
    Loveland, Mark
    Dent, Samuel
    [J]. ENTROPY, 2024, 26 (08)
  • [4] SOBOLEV TRAINING FOR PHYSICS-INFORMED NEURAL NETWORKS
    Son, Hwijae
    Jang, Jin woo
    Han, Woo jin
    Hwang, Hyung ju
    [J]. COMMUNICATIONS IN MATHEMATICAL SCIENCES, 2023, 21 (06) : 1679 - 1705
  • [5] Physics-informed neural networks for diffraction tomography
    Saba, Amirhossein
    Gigli, Carlo
    Ayoub, Ahmed B.
    Psaltis, Demetri
    [J]. ADVANCED PHOTONICS, 2022, 4 (06):
  • [6] Enhanced physics-informed neural networks for hyperelasticity
    Abueidda, Diab W.
    Koric, Seid
    Guleryuz, Erman
    Sobh, Nahil A.
    [J]. INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN ENGINEERING, 2023, 124 (07) : 1585 - 1601
  • [7] Physics-informed neural networks for consolidation of soils
    Zhang, Sheng
    Lan, Peng
    Li, Hai-Chao
    Tong, Chen-Xi
    Sheng, Daichao
    [J]. ENGINEERING COMPUTATIONS, 2022, 39 (07) : 2845 - 2865
  • [8] Physics-Informed Neural Networks for shell structures
    Bastek, Jan-Hendrik
    Kochmann, Dennis M.
    [J]. EUROPEAN JOURNAL OF MECHANICS A-SOLIDS, 2023, 97
  • [9] fPINNs: FRACTIONAL PHYSICS-INFORMED NEURAL NETWORKS
    Pang, Guofei
    Lu, Lu
    Karniadakis, George E. M.
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2019, 41 (04): : A2603 - A2626
  • [10] On physics-informed neural networks for quantum computers
    Markidis, Stefano
    [J]. FRONTIERS IN APPLIED MATHEMATICS AND STATISTICS, 2022, 8