Neural network training with optimal bounded ellipsoid algorithm

被引:8
|
作者
de Jesus Rubio, Jose [1 ,2 ]
Yu, Wen [3 ]
Ferreyra, Andres [1 ]
机构
[1] UAM Azcapotzalco, Dept Elect, Area Instrumentac, Mexico City, DF, Mexico
[2] Inst Politecn Nacl ESIME Azcapotzalco, Secc Estudios Posgrad & Invest, Mexico City, DF, Mexico
[3] IPN, CINVESTAV, Dept Automat Control, Mexico City 07360, DF, Mexico
来源
NEURAL COMPUTING & APPLICATIONS | 2009年 / 18卷 / 06期
关键词
Neural networks; Identification; Ellipsoid algorithm; Stability; SYSTEM-IDENTIFICATION; KALMAN FILTER; NOISE;
D O I
10.1007/s00521-008-0203-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Compared to normal learning algorithms, for example backpropagation, the optimal bounded ellipsoid (OBE) algorithm has some better properties, such as faster convergence, since it has a similar structure as Kalman filter. OBE has some advantages over Kalman filter training, the noise is not required to be Guassian. In this paper OBE algorithm is applied in training the weights of the feedforward neural network for nonlinear system identification. Both hidden layers and output layers can be updated. From a dynamic system point of view, such training can be useful for all neural network applications requiring real-time updating of the weights. Two simulations give the effectiveness of the suggested algorithm.
引用
收藏
页码:623 / 631
页数:9
相关论文
共 50 条
  • [41] A parallel differential evolution algorithm for neural network training
    Kwedlo, Wojciech
    Bandurski, Krzysztof
    [J]. PAR ELEC 2006: INTERNATIONAL SYMPOSIUM ON PARALLEL COMPUTING IN ELECTRICAL ENGINEERING, PROCEEDINGS, 2006, : 319 - +
  • [42] Studies on optimal algorithm of the revisable structure of neural network
    Zhenfa Qi
    [J]. DYNAMICS OF CONTINUOUS DISCRETE AND IMPULSIVE SYSTEMS-SERIES A-MATHEMATICAL ANALYSIS, 2006, 13 : 1047 - 1049
  • [43] A fast and numerically robust neural network training algorithm
    Zhang, Youmin
    [J]. ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING - ICAISC 2006, PROCEEDINGS, 2006, 4029 : 160 - 169
  • [44] Comparing backpropagation with a genetic algorithm for neural network training
    Gupta, JND
    Sexton, RS
    [J]. OMEGA-INTERNATIONAL JOURNAL OF MANAGEMENT SCIENCE, 1999, 27 (06): : 679 - 684
  • [45] A novel rough neural network and its training algorithm
    Sun, SH
    Mei, XD
    Zhang, ZL
    [J]. IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2002, E85D (02): : 426 - 431
  • [46] A constructive algorithm for training heterogeneous neural network ensemble
    Fu, Xianghua
    Wang, Zhiqiang
    Feng, Boqin
    [J]. ROUGH SETS AND KNOWLEDGE TECHNOLOGY, PROCEEDINGS, 2006, 4062 : 396 - 401
  • [47] Research on fast training algorithm for recurrent neural network
    Gong, DW
    Xu, SF
    Sun, XY
    [J]. ISIE 2001: IEEE INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS PROCEEDINGS, VOLS I-III, 2001, : 446 - 448
  • [48] Training algorithm of one feedforward wavelet neural network
    Zhao, G
    Zhao, J
    Chen, W
    Li, JP
    [J]. WAVELET ANALYSIS AND ITS APPLICATIONS, AND ACTIVE MEDIA TECHNOLOGY, VOLS 1 AND 2, 2004, : 135 - 142
  • [49] Hybrid Algorithm for the Optimization of Training Convolutional Neural Network
    Albeahdili, Hayder M.
    Han, Tony
    Islam, Naz E.
    [J]. INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2015, 6 (10) : 79 - 85
  • [50] A genetic algorithm to obtain the optimal recurrent neural network
    Blanco, A
    Delgado, M
    Pegalajar, MC
    [J]. INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2000, 23 (01) : 67 - 83