A computational framework for neural network-based variational Monte Carlo with Forward Laplacian

被引:3
|
作者
Li, Ruichen [1 ,2 ]
Ye, Haotian [3 ]
Jiang, Du [1 ,2 ]
Wen, Xuelan [2 ]
Wang, Chuwei [4 ]
Li, Zhe [2 ]
Li, Xiang [2 ]
He, Di [1 ]
Chen, Ji [5 ]
Ren, Weiluo [2 ]
Wang, Liwei [1 ,6 ]
机构
[1] Peking Univ, Sch Intelligence Sci & Technol, Natl Key Lab Gen Artificial Intelligence, Beijing, Peoples R China
[2] ByteDance Res, Beijing, Peoples R China
[3] Peking Univ, Yuanpei Coll, Beijing, Peoples R China
[4] Peking Univ, Sch Math Sci, Beijing, Peoples R China
[5] Peking Univ, Interdisciplinary Inst Light Element Quantum Mat, Frontiers Sci Ctr Nanooptoelect, Sch Phys, Beijing, Peoples R China
[6] Peking Univ, Ctr Machine Learning Res, Beijing, Peoples R China
基金
美国国家科学基金会; 国家重点研发计划; 中国国家自然科学基金;
关键词
IRON-PERIOD; SPECTROSCOPY; DATABASE;
D O I
10.1038/s42256-024-00794-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural network-based variational Monte Carlo (NN-VMC) has emerged as a promising cutting-edge technique of ab initio quantum chemistry. However, the high computational cost of existing approaches hinders their applications in realistic chemistry problems. Here we report a development of NN-VMC that achieves a remarkable speed-up rate, thereby greatly extending the applicability of NN-VMC to larger systems. Our key design is a computational framework named Forward Laplacian, which computes the Laplacian associated with neural networks, the bottleneck of NN-VMC, through an efficient forward propagation process. We then demonstrate that Forward Laplacian can further facilitate more developments of acceleration methods across various aspects, including optimization for sparse derivative matrix and efficient network design. Empirically, our approach enables NN-VMC to investigate a broader range of systems, providing valuable references to other ab initio methods. The results demonstrate a great potential in applying deep learning methods to solve general quantum mechanical problems. Realistic quantum mechanical simulations are computationally costly to perform but can be approximated using neural network models. Li and colleagues propose a forward propagation method in lieu of traditional backpropagation to speed up these neural network-based approaches.
引用
收藏
页码:180 / 186
页数:7
相关论文
共 50 条
  • [1] A computational framework for neural network-based variational Monte Carlo with Forward Laplacian
    Ruichen Li
    Haotian Ye
    Du Jiang
    Xuelan Wen
    Chuwei Wang
    Zhe Li
    Xiang Li
    Di He
    Ji Chen
    Weiluo Ren
    Liwei Wang
    Nature Machine Intelligence, 2024, 6 : 209 - 219
  • [2] Neural network variational Monte Carlo for positronic chemistry
    Cassella, Gino
    Foulkes, W. M. C.
    Pfau, David
    Spencer, James S.
    NATURE COMMUNICATIONS, 2024, 15 (01)
  • [3] Interatomic force from neural network based variational quantum Monte Carlo
    Qian, Yubing
    Fu, Weizhong
    Ren, Weiluo
    Chen, Ji
    JOURNAL OF CHEMICAL PHYSICS, 2022, 157 (16):
  • [4] Hamiltonian Monte Carlo based on evidence framework for Bayesian learning to neural network
    Ramchoun, Hassan
    Ettaouil, Mohamed
    SOFT COMPUTING, 2019, 23 (13) : 4815 - 4825
  • [5] Hamiltonian Monte Carlo based on evidence framework for Bayesian learning to neural network
    Hassan Ramchoun
    Mohamed Ettaouil
    Soft Computing, 2019, 23 : 4815 - 4825
  • [6] Efficient Monte Carlo sampling of inverse problems using a neural network-based forward-applied to GPR crosshole traveltime inversion
    Hansen, T. M.
    Cordua, K. S.
    GEOPHYSICAL JOURNAL INTERNATIONAL, 2017, 211 (03) : 1524 - 1533
  • [7] Explicitly antisymmetrized neural network layers for variational Monte Carlo simulation
    Lin, Jeffmin
    Goldshlager, Gil
    Lin, Lin
    JOURNAL OF COMPUTATIONAL PHYSICS, 2023, 474
  • [8] Variance extrapolation method for neural-network variational Monte Carlo
    Fu, Weizhong
    Ren, Weiluo
    Chen, Ji
    MACHINE LEARNING-SCIENCE AND TECHNOLOGY, 2024, 5 (01):
  • [9] Plagiarism Detection Framework Using Monte Carlo Based Artificial Neural Network for Nepali Language
    Bachchan, Rakesh Kumar
    Timalsina, Arun Kumar
    PROCEEDINGS ON 2018 IEEE 3RD INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND SECURITY (ICCCS), 2018, : 122 - 127
  • [10] Seismic waveform inversion using a neural network-based forward
    Fu, Hongsun
    Zhang, Yan
    Ma, Mingyue
    SECOND INTERNATIONAL CONFERENCE ON PHYSICS, MATHEMATICS AND STATISTICS, 2019, 1324