Optimization of neural network structure and learning parameters using genetic algorithms

被引:8
|
作者
Han, SS
May, GS
机构
关键词
D O I
10.1109/TAI.1996.560452
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural network models of semiconductor manufacturing processes offer advantages in accuracy and generalization over traditional methods. However model development is complicated by the fact that back-propagation neural networks contain several adjustable parameters whose optimal values are initially unknown. These include learning rate, momentum, training tolerance, and the number of hidden layer neurons. This paper investigates of the use of genetic algorithms (GAs) to determine the optimal neural network parameters for modeling plasma-enhanced chemical vapor deposition (PECVD) of silicon dioxide films. To find an optimal parameter set for the PECVD models, a performance index is defined and used in the GA objective function. This index accounts for both prediction error as well as training error, with a higher emphasis on reducing prediction error. Results of the genetic search are compared with a similar search using the simplex algorithm. The GA search performed approximately 10% better in reducing training error and 66% better in reducing prediction error.
引用
收藏
页码:200 / 206
页数:7
相关论文
共 50 条
  • [1] Genetic Algorithms for MLP Neural Network Parameters Optimization
    Er, Meng Joo
    Liu, Fan
    CCDC 2009: 21ST CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-6, PROCEEDINGS, 2009, : 3653 - 3658
  • [2] Structure optimization of fuzzy neural network as an expert system using genetic algorithms
    Kusumoputro, B
    Irwanto, P
    APPLICATIONS AND SCIENCE OF COMPUTATIONAL INTELLIGENCE III, 2000, 4055 : 219 - 225
  • [3] Neural network optimization using genetic algorithms for speech recognition
    Mouria-Beji, Faryel
    International Journal of Engineering Intelligent Systems for Electrical Engineering and Communications, 2002, 10 (02): : 69 - 74
  • [4] Hyperparameter Optimization in Convolutional Neural Network using Genetic Algorithms
    Aszemi, Nurshazlyn Mohd
    Dominic, P. D. D.
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2019, 10 (06) : 269 - 278
  • [5] Hyperparameter optimization in convolutional neural network using genetic algorithms
    Aszemi N.M.
    Dominic P.D.D.
    International Journal of Advanced Computer Science and Applications, 2019, 10 (06): : 269 - 278
  • [6] Neural network optimization using genetic algorithms for speech recognition
    Mouria-Beji, F
    ENGINEERING INTELLIGENT SYSTEMS FOR ELECTRICAL ENGINEERING AND COMMUNICATIONS, 2002, 10 (02): : 69 - 74
  • [7] Convolutional Neural Network Hyper-Parameters Optimization based on Genetic Algorithms
    Loussaief, Sehla
    Abdelkrim, Afef
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2018, 9 (10) : 252 - 266
  • [8] Tuning the structure and parameters of a neural network by a new network model based on genetic algorithms
    Li, Xiangmei
    International Journal of Digital Content Technology and its Applications, 2012, 6 (11) : 29 - 36
  • [9] Application of improved operators genetic algorithms in parameters learning of fuzzy neural network
    Wang, Yanqiu
    Zhao, Yueling
    Wang, Jianhui
    Gu, Shusheng
    DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES A-MATHEMATICAL ANALYSIS, 2006, 13 : 655 - 657
  • [10] Optimization of neural network inputs with genetic algorithms
    Kupinski, M
    Giger, ML
    Doi, K
    DIGITAL MAMMOGRAPHY '96, 1996, 1119 : 401 - 404