Speed-Up Method for Neural Network Learning Using GPGPU

被引:0
|
作者
Tsuchida, Yuta [1 ]
Yoshioka, Michifumi [1 ]
Omatu, Sigeru [2 ]
机构
[1] Osaka Prefecture Univ, Grad Sch Engn, Dept Comp Sci & Intelligent Syst, Sakai, Osaka 5998531, Japan
[2] Osaka Inst Technol, Fac Engn, Informat Elect Informat & Commun Engn, Sakai, Osaka 5358585, Japan
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
GPU is the dedicated circuit to draw the graphics, so it has a characteristic that the many simple arithmetic circuits are implemented. This characteristic is hoped to apply the massive parallelism not only graphic processing. In this paper, the neural network, one of the pattern recognition algorithms is applied to be faster by using GPU. In the learning of the neural network, there are many points to be processed at the same time. We propose a method which makes the neural network be parallelized in three points. The parallelizations are implemented in neural networks which have different initial weight coefficients, the learning patterns or neurons in a layer of neural network. These methods are used in combination, but the first method can be processed independently. Therefore one of the three methods, the first method, is employed as comparison to compare with the proposed methods. As the result, the proposed method is 6 times faster than comparison method.
引用
收藏
页码:73 / +
页数:2
相关论文
共 50 条
  • [1] Speed Up Method for Neural Network Learning by Using GPGPU
    Tsuchida, Yuta
    Yoshioka, Michifumi
    [J]. 6TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS, AND THE 13TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS, 2012, : 193 - 196
  • [2] SPEED-UP OF OBJECT DETECTION NEURAL NETWORK WITH GPU
    Fukagai, Takuya
    Maeda, Kyosuke
    Tanabe, Satoshi
    Shirahata, Koichi
    Tomita, Yasumoto
    Ike, Atsushi
    Nakagawa, Akira
    [J]. 2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 301 - 305
  • [3] Speed-up coherent Ising machine with a spiking neural network
    Lu, Bo
    Fan, Chen-Rui
    Liu, Lu
    Wen, Kai
    Wang, Chuan
    [J]. OPTICS EXPRESS, 2023, 31 (03) : 3676 - 3684
  • [4] NEURAL NETWORK IMPLEMENTATIONS AND SPEED-UP ON MASSIVELY PARALLEL MACHINES
    AZEMABARAC, ME
    REFENES, AN
    [J]. MICROPROCESSING AND MICROPROGRAMMING, 1992, 35 (1-5): : 747 - 754
  • [5] Speed-up of the R4-rule for Distance-Based Neural Network Learning
    Tominaga, Naoki
    Zhao, Qiangfu
    [J]. 2009 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC 2009), VOLS 1-9, 2009, : 3389 - 3394
  • [6] Speed-up of PEEC method by using wavelet transform
    Antonini, G
    Orlandi, A
    Ruehli, AE
    [J]. 2000 IEEE INTERNATIONAL SYMPOSIUM ON ELECTROMAGNETIC COMPATIBILITY, VOLS 1 AND 2, SYMPOSIUM RECORD, 2000, : 95 - 100
  • [7] Minibatch Processing for Speed-up and Scalability of Spiking Neural Network Simulation
    Saunders, Daniel J.
    Sigrist, Cooper
    Chaney, Kenneth
    Kozma, Robert
    Siegelmann, Hava T.
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [8] Quantum speed-up for unsupervised learning
    Esma Aïmeur
    Gilles Brassard
    Sébastien Gambs
    [J]. Machine Learning, 2013, 90 : 261 - 287
  • [9] Quantum speed-up for unsupervised learning
    Aimeur, Esma
    Brassard, Gilles
    Gambs, Sebastien
    [J]. MACHINE LEARNING, 2013, 90 (02) : 261 - 287
  • [10] Acceleration of Neural Network Learning by GPGPU
    Tsuchida, Yuta
    Yoshioka, Michifumi
    [J]. ELECTRONICS AND COMMUNICATIONS IN JAPAN, 2013, 96 (08) : 59 - 66