Multifold Acceleration of Neural Network Computations Using GPU

被引:0
|
作者
Guzhva, Alexander [1 ]
Dolenko, Sergey [1 ]
Persiantsev, Igor [1 ]
机构
[1] Moscow MV Lomonosov State Univ, DV Skobeltsyn Inst Nucl Phys, Moscow 119991, Russia
关键词
GPGPU; neural networks; perceptron; NVIDIA CUDA; parallel computations;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With emergence of graphics processing units (CPU) of the latest generation, it became possible to undertake neural network based computations using CPU on serially produced video display adapters. In this study, NVIDIA CUDA technology has been used to implement standard back-propagation algorithm for training multiple perceptrons simultaneously on CPU. For the problem considered, CPU-based implementation (on NVIDIA CTX 260 CPU) has lead to a 50x speed increase compared to a highly optimized CPU-based computer program, and more than 150x compared to a commercially available CPU-based software (Neuro Shell 2) (AMD Athlon 64 Dual core 6000+ processor).
引用
收藏
页码:373 / 380
页数:8
相关论文
共 50 条
  • [41] Driver Identification Using Histogram and Neural Network from Acceleration Data
    Virojboonkiate, Nuttun
    Vateekul, Peerapon
    Rojviboonchai, Kultida
    2017 17TH IEEE INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY (ICCT 2017), 2017, : 1560 - 1564
  • [42] Large Scale Recurrent Neural Network on GPU
    Li, Boxun
    Zhou, Erjin
    Huang, Bo
    Duan, Jiayi
    Wang, Yu
    Xu, Ningyi
    Zhang, Jiaxing
    Yang, Huazhong
    PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 4062 - 4069
  • [43] Efficient Neural Network Acceleration on GPGPU using Content Addressable Memory
    Imani, Mohsen
    Peroni, Daniel
    Kim, Yeseong
    Rahimi, Abbas
    Rosing, Tajana
    PROCEEDINGS OF THE 2017 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE), 2017, : 1026 - 1031
  • [44] Acceleration for Query-by-Example Using Posteriorgram of Deep Neural Network
    Obara, Masato
    Moriya, Munehiro
    Konno, Ryota
    Kojima, Kazunori
    Tanaka, Kazuyo
    Lee, Shi-wook
    Itoh, Yoshiaki
    2017 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC 2017), 2017, : 1616 - 1620
  • [45] Prediction of peak horizontal acceleration using an artificial neural network model
    Emami, S.M.R.
    Harada, Takanori
    Iwao, Yushiro
    Structural Engineering/Earthquake Engineering, 1996, 13 (02):
  • [46] A Speed Regression Using Acceleration Data in a Deep Convolutional Neural Network
    Wang, Karl L.
    Xu, Jingya
    IEEE ACCESS, 2019, 7 : 9351 - 9356
  • [47] On Reverse Engineering Neural Network Implementation on GPU
    Chmielewski, Lukasz
    Weissbart, Leo
    APPLIED CRYPTOGRAPHY AND NETWORK SECURITY WORKSHOPS, ACNS 2021, 2021, 12809 : 96 - 113
  • [48] Neural network pruning and hardware acceleration
    Jeong, Taehee
    Ghasemi, Ehsam
    Tuyls, Jorn
    Delaye, Elliott
    Sirasao, Ashish
    2020 IEEE/ACM 13TH INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING (UCC 2020), 2020, : 440 - 445
  • [49] Embedding GPU Computations in Hadoop
    Zhu, Jie
    Jiang, Hai
    Li, Juanjuan
    Hardesty, Erikson
    Li, Kuan-Ching
    Li, Zhongwen
    INTERNATIONAL JOURNAL OF NETWORKED AND DISTRIBUTED COMPUTING, 2014, 2 (04) : 211 - 220
  • [50] Acceleration of Neural Network Learning by GPGPU
    Tsuchida, Yuta
    Yoshioka, Michifumi
    ELECTRONICS AND COMMUNICATIONS IN JAPAN, 2013, 96 (08) : 59 - 66