A hybrid training method of convolution neural networks using adaptive cooperative particle swarm optimiser

被引:0
|
作者
Xiao G. [1 ]
Liu H. [2 ]
Guo W. [3 ]
Wang L. [4 ]
机构
[1] Department of Mechanical and Electrical Technology, Jinggangshan University, Ji'an
[2] Department of Electronics and Information, Jinggangshan University, Ji'an
[3] Sino-German College of Applied Science, Tongji University, Shanghai
[4] Department of Electronics and Information, Tongji University, Shanghai
基金
中国国家自然科学基金;
关键词
BP algorithm; CNN; Convolution neural networks; Cooperative particle swarm optimisation; CPSO; Learning automata;
D O I
10.1504/IJWMC.2019.097418
中图分类号
学科分类号
摘要
For solving the problem that it is easy to fall into the local minimum in Convolution Neural Networks (CNN) training, a hybrid training algorithm based on heuristic algorithm is proposed. Firstly, an Adaptive Cooperative Particle Swarm Optimisation (ACPSO) is proposed, which uses a learning automata to adaptively divide the subpopulation of the Cooperative Particle Swarm Optimisation (CPSO), and makes the decision variables with strong coupling relationship enter the same subpopulation. Then, the connection weights of CNN are considered as elements in particles and the CNN is trained by ACPSO algorithm. The output of the ACPSO algorithm is applied as the initial weight of the BP algorithm for the purpose of speeding up the training speed of the CNN. The experimental results show that the ACPSO-BP algorithm has achieved good results, and the recognition rate of the CNN is improved. Thus it has the potential to be applied to other deep learning fields. Copyright © 2019 Inderscience Enterprises Ltd.
引用
收藏
页码:18 / 26
页数:8
相关论文
共 50 条
  • [1] Training High-Dimensional Neural Networks with Cooperative Particle Swarm Optimiser
    Rakitianskaia, Anna
    Engelbrecht, Andries
    [J]. PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 4011 - 4018
  • [2] Hybrid Particle Swarm training for Convolution Neural Network (CNN)
    Chhabra, Yoshika
    Varshney, Sanchit
    Ankita
    [J]. 2017 TENTH INTERNATIONAL CONFERENCE ON CONTEMPORARY COMPUTING (IC3), 2017, : 381 - 383
  • [3] Cooperative Charged Particle Swarm Optimiser
    Rakitianskaia, Anna
    Engelbrecht, Andries P.
    [J]. 2008 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1-8, 2008, : 933 - 939
  • [4] A Hybrid of Cooperative Particle Swarm Optimization and Cultural Algorithm for Neural Fuzzy Networks
    Chen, Cheng-Hung
    Liu, Yong-Cheng
    Lin, Cheng-Jian
    Lin, Chin-Teng
    [J]. 2008 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS, VOLS 1-5, 2008, : 238 - +
  • [5] Training product unit networks using Cooperative Particle Swarm Optimisers
    van den Bergh, F
    Engelbrecht, AP
    [J]. IJCNN'01: INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2001, : 126 - 131
  • [6] Training neural networks using Multiobjective Particle Swarm Optimization
    Yusiong, John Paul T.
    Naval, Prospero C., Jr.
    [J]. ADVANCES IN NATURAL COMPUTATION, PT 1, 2006, 4221 : 879 - 888
  • [7] Training feedforward neural networks using hybrid particle swarm optimization and gravitational search algorithm
    Mirjalili, SeyedAli
    Hashim, Siti Zaiton Mohd
    Sardroudi, Hossein Moradian
    [J]. APPLIED MATHEMATICS AND COMPUTATION, 2012, 218 (22) : 11125 - 11137
  • [8] Optimised DWT using cooperative particle swarm optimiser for hybrid domain based medical and natural image denoising
    Velayudham, A.
    Kumar, K. Madhan
    Kanthavel, R.
    [J]. INTERNATIONAL JOURNAL OF BIOMEDICAL ENGINEERING AND TECHNOLOGY, 2019, 31 (01) : 1 - 34
  • [9] Optimised DWT using cooperative particle swarm optimiser for hybrid domain based medical and natural image denoising
    Velayudham, A.
    Madhan Kumar, K.
    Kanthavel, R.
    [J]. International Journal of Biomedical Engineering and Technology, 2019, 31 (01): : 1 - 34
  • [10] Designing neural networks using hybrid particle swarm optimization
    Liu, B
    Wang, L
    Jin, YH
    Huang, DX
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2005, PT 1, PROCEEDINGS, 2005, 3496 : 391 - 397