On-line learning in recurrent neural networks using nonlinear Kalman filters

被引：0

作者：

Todorovic, B ^{[1
]}

Stankovic, M ^{[1
]}

Moraga, C ^{[1
]}

机构：

[1] Univ Nish, Fac Occupat Safety, YU-18000 Nish, Serbia Monteneg, Yugoslavia

来源：

PROCEEDINGS OF THE 3RD IEEE INTERNATIONAL SYMPOSIUM ON SIGNAL PROCESSING AND INFORMATION TECHNOLOGY | 2003年

关键词：

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

The extended Kalman filter has been successfully applied to the feedforward and the recurrent neural network training. Recently introduced derivative-free filters (Unscented Kalman Filter and Divided Difference Filter) outperform the extended Kalman filter in nonlinear state estimation. In the parameter estimation of the feedforward neural networks UKF and DDF are comparable or slightly better than EKF with a significant advantage that they do not demand calculation of the neural network Jacobian. In this paper, we consider the application Of EKF, UKF and DDF to the recurrent neural network training. The class of non-linear autoregressive recurrent neural networks with exogenous inputs is chosen as a basic architecture due to its powerful representational capabilities.

引用

页码：802 / 805

页数：4

共 50 条

[31] Harmonic neural networks for on-line learning vector quantisation
Wang, JH
Peng, CY
Rau, JD
[J]. IEE PROCEEDINGS-VISION IMAGE AND SIGNAL PROCESSING, 2000, 147 (05): : 485 - 492
[32] On-line wear estimation using neural networks
Ghasempoor, A
Moore, TN
Jeswiet, J
[J]. PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART B-JOURNAL OF ENGINEERING MANUFACTURE, 1998, 212 (02) : 105 - 112
[33] Convergent on-line algorithms for supervised learning in neural networks
Grippo, L
[J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (06): : 1284 - 1299
[34] On-line learning in RBF neural networks: a stochastic approach
Marinaro, M
Scarpetta, S
[J]. NEURAL NETWORKS, 2000, 13 (07) : 719 - 729
[35] On-line supervised learning for dynamic security classification using probabilistic neural networks
Gavoyiannis, AE
Voumvoulakis, EM
Hatziargyriou, ND
[J]. 2005 IEEE POWER ENGINEERING SOCIETY GENERAL MEETING, VOLS, 1-3, 2005, : 2669 - 2675
[36] Sensor validation using hardware-based on-line learning neural networks
Napolitano, MR
Silvestri, G
Windon, DA
Casanova, JL
Innocenti, M
[J]. IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 1998, 34 (02) : 456 - 468
[37] On-Line Parameters Estimation of Low Scale SPSG Using Discrete Kalman Filters
Larakeb, M.
Bentounsi, A.
Djeghloud, H.
[J]. JOURNAL OF ELECTRICAL SYSTEMS, 2016, 12 (04) : 770 - 785
[38] On-line optimizing neural networks for Kalman filtered real-time identification
Filasová, A
Krokavec, D
[J]. ICCC 2005: IEEE 3RD INTERNATIONAL CONFERENCE ON COMPUTATIONAL CYBERNETICS, 2005, : 303 - 307
[39] Dynamic multilayer neural networks for nonlinear system on-line identification
Yu, W
Poznyak, AS
Sanchez, EN
[J]. PROCEEDINGS OF THE 2000 IEEE INTERNATIONAL SYMPOSIUM ON INTELLIGENT CONTROL, 2000, : 25 - 30
[40] On-line identification of nonlinear systems using Volterra polynomial basis function neural networks
Liu, GP
Kadirkamanathan, V
Billings, SA
[J]. NEURAL NETWORKS, 1998, 11 (09) : 1645 - 1657

← 1 2 3 4 5 →