Optimizing convolutional neural networks architecture using a modified particle swarm optimization for image classification

被引:11
|
作者
Elhani, D. [1 ]
Megherbi, A. C. [1 ]
Zitouni, A. [1 ]
Dornaika, F. [2 ]
Sbaa, S. [1 ]
Taleb-Ahmed, A. [3 ]
机构
[1] Univ Biskra, Dept Elect Engn, Biskra, Algeria
[2] Ho Chi Minh City Open Univ, 97 Vo Van Tan,Ward Vo Thi Sau, Ho Chi Minh City 70000, Vietnam
[3] Univ Lille, Univ Polytech Hauts De France, CNRS, Cent Lille,UMR 8520, F-59313 Valenciennes, France
关键词
Convolutional neural networks; Neural network design; Hyperparameters; Particle swarm optimization; Image classification; ALGORITHM;
D O I
10.1016/j.eswa.2023.120411
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Although Convolutional Neural Networks (CNNs) have been shown to be highly effective in image classification tasks, designing their architecture to achieve optimal results is often challenging. This process is time consum-ing, requires significant effort and expertise, and is complicated by the large number of hyperparameters. To address this problem, in this work we propose an approach that reduces human intervention and automatically generates the best CNN design. Our approach uses a variant of Particle Swarm Optimization (PSO), called Particle Swarm Optimization without Velocity (PSWV), to speed up convergence and reduce the number of iterations required to determine the optimal CNN hyperparameters. We developed a novel strategy to determine the updated position of each particle using a linear combination of the best position of the particle and the best position of the swarm without relying on the velocity equation. Our algorithm harnesses the power of the variable-length encoding strategy to represent particles within the population, thereby providing swift convergence towards the best architecture. We evaluate our proposed algorithm against several recent algorithms in the literature by using nine benchmark datasets for classification tasks and comparing it to 27 other algorithms, including state-of-the-art ones. Our experimental results show that our proposed method, pswvCNN, is able to quickly find effective CNN architectures that provide comparable performance to the best currently available designs, indicating its significant potential.
引用
收藏
页数:17
相关论文
共 50 条
  • [1] Particle Swarm Optimization for Automatically Evolving Convolutional Neural Networks for Image Classification
    Lawrence, Tom
    Zhang, Li
    Lim, Chee Peng
    Phillips, Emma-Jane
    [J]. IEEE ACCESS, 2021, 9 : 14369 - 14386
  • [2] Efficient Optimization of Convolutional Neural Networks using Particle Swarm Optimization
    Yamasaki, Toshihiko
    Honma, Takuto
    Aizawa, Kiyoharu
    [J]. 2017 IEEE THIRD INTERNATIONAL CONFERENCE ON MULTIMEDIA BIG DATA (BIGMM 2017), 2017, : 70 - 73
  • [3] Particle Swarm Optimization for Compact Neural Architecture Search for Image Classification
    Huang, Junhao
    Xue, Bing
    Sun, Yanan
    Zhang, Mengjie
    Yen, Gary G.
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2023, 27 (05) : 1298 - 1312
  • [4] Modified Convolutional Neural Networks Architecture for Hyperspectral Image Classification (Extra-Convolutional Neural Networks)
    Hamouda, Maissa
    Bouhlel, Med Salim
    [J]. IET IMAGE PROCESSING, 2021,
  • [5] Evolving Deep Convolutional Neural Networks by Variable-length Particle Swarm Optimization for Image Classification
    Wang, Bin
    Sun, Yanan
    Xue, Bing
    Zhang, Mengjie
    [J]. 2018 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2018, : 1514 - 1521
  • [6] Particle swarm optimization of deep neural networks architectures for image classification
    Fernandes Junior, Francisco Erivaldo
    Yen, Gary G.
    [J]. SWARM AND EVOLUTIONARY COMPUTATION, 2019, 49 : 62 - 74
  • [7] Evolving deep convolutional neural networks by quantum behaved particle swarm optimization with binary encoding for image classification
    Li, Yangyang
    Xiao, Junjie
    Chen, Yanqiao
    Jiao, Licheng
    [J]. NEUROCOMPUTING, 2019, 362 : 156 - 165
  • [8] A Modified Particle Swarm Optimization Algorithm for Optimizing Artificial Neural Network in Classification Tasks
    Ang, Koon Meng
    Chow, Cher En
    El-Kenawy, El-Sayed M.
    Abdelhamid, Abdelaziz A.
    Ibrahim, Abdelhameed
    Karim, Faten Khalid
    Khafaga, Doaa Sami
    Tiang, Sew Sun
    Lim, Wei Hong
    [J]. PROCESSES, 2022, 10 (12)
  • [9] Image classification using particle swarm optimization
    Omran, MG
    Engelbrecht, AP
    Salman, A
    [J]. RECENT ADVANCES IN SIMULATED EVOLUTION AND LEARNING, 2004, 2 : 347 - 365
  • [10] Fast Image Super-Resolution Using Particle Swarm Optimization-Based Convolutional Neural Networks
    Zhou, Chaowei
    Xiong, Aimin
    [J]. SENSORS, 2023, 23 (04)