Multifold Acceleration of Neural Network Computations Using GPU

被引:0
|
作者
Guzhva, Alexander [1 ]
Dolenko, Sergey [1 ]
Persiantsev, Igor [1 ]
机构
[1] Moscow MV Lomonosov State Univ, DV Skobeltsyn Inst Nucl Phys, Moscow 119991, Russia
关键词
GPGPU; neural networks; perceptron; NVIDIA CUDA; parallel computations;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With emergence of graphics processing units (CPU) of the latest generation, it became possible to undertake neural network based computations using CPU on serially produced video display adapters. In this study, NVIDIA CUDA technology has been used to implement standard back-propagation algorithm for training multiple perceptrons simultaneously on CPU. For the problem considered, CPU-based implementation (on NVIDIA CTX 260 CPU) has lead to a 50x speed increase compared to a highly optimized CPU-based computer program, and more than 150x compared to a commercially available CPU-based software (Neuro Shell 2) (AMD Athlon 64 Dual core 6000+ processor).
引用
收藏
页码:373 / 380
页数:8
相关论文
共 50 条
  • [31] Comparison of intraocular lens computations using a neural network versus the Holladay formula
    Clarke, GP
    Burmeister, J
    JOURNAL OF CATARACT AND REFRACTIVE SURGERY, 1997, 23 (10): : 1585 - 1589
  • [32] A neural network model for slope stability computations
    Kumar, S.
    Basudhar, P. K.
    GEOTECHNIQUE LETTERS, 2018, 8 (02) : 149 - 154
  • [33] Neural network enhanced computations on coarse grids
    Nordstrom, Jan
    Alund, Oskar
    JOURNAL OF COMPUTATIONAL PHYSICS, 2021, 425
  • [34] NEURAL NETWORK TRAINING WITH APPROXIMATE LOGARITHMIC COMPUTATIONS
    Sanyal, Arnab
    Beerel, Peter A.
    Chugg, Keith M.
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 3122 - 3126
  • [35] Nodule Detection with Convolutional Neural Network Using Apache Spark and GPU Frameworks
    Venkatesan, Nikitha Johnsirani
    Shin, Dong Ryeol
    Nam, Choon Sung
    APPLIED SCIENCES-BASEL, 2021, 11 (06):
  • [36] Accelerating Sparse Deep Neural Network Inference Using GPU Tensor Cores
    Sun, Yufei
    Zheng, Long
    Wang, Qinggang
    Ye, Xiangyu
    Huang, Yu
    Yao, Pengcheng
    Liao, Xiaofei
    Jin, Hai
    2022 IEEE HIGH PERFORMANCE EXTREME COMPUTING VIRTUAL CONFERENCE (HPEC), 2022,
  • [37] Optimization and Analysis of Parallel Back Propagation Neural Network on GPU Using CUDA
    Wang, Yaobin
    Tang, Pingping
    An, Hong
    Liu, Zhiqin
    Wang, Kun
    Zhou, Yong
    NEURAL INFORMATION PROCESSING, PT III, 2015, 9491 : 156 - 163
  • [38] Forecasting large scale conditional volatility and covariance using neural network on GPU
    Xianggao Cai
    Guoming Lai
    Xiaola Lin
    The Journal of Supercomputing, 2013, 63 : 490 - 507
  • [39] Forecasting large scale conditional volatility and covariance using neural network on GPU
    Cai, Xianggao
    Lai, Guoming
    Lin, Xiaola
    JOURNAL OF SUPERCOMPUTING, 2013, 63 (02): : 490 - 507
  • [40] GPU Occupancy Prediction of Deep Learning Models Using Graph Neural Network
    Mei, Hengquan
    Qu, Huaizhi
    Sun, Jingwei
    Gao, Yanjie
    Lin, Haoxiang
    Sun, Guangzhong
    2023 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING, CLUSTER, 2023, : 318 - 329