The local true weight decay recursive least square algorithm

被引:0
|
作者
Leung, Chi Sing [1 ]
Wong, Kwok-Wo [1 ]
Xu, Yong [1 ]
机构
[1] City Univ Hong Kong, Dept Elect Engn, Hong Kong, Hong Kong, Peoples R China
来源
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The true weight decay recursive least square (TWDRLS) algorithm is an efficient fast online training algorithm for feedforward neural networks. However, its computational and space complexities are very large. This paper first presents a set of more compact TWDRLS equations. Afterwards, we propose a local version of TWDRLS to reduce the computational and space complexities. The effectiveness of this local version is demonstrated by simulations. Our analysis shows that the computational and space complexities of the local TWDRLS are much smaller than those of the global TWDRLS.
引用
收藏
页码:456 / 465
页数:10
相关论文
共 50 条
  • [1] Decouple implementation of weight decay for recursive least square
    Andrew Chi-Sing Leung
    Yi Xiao
    Yong Xu
    Kwok-Wo Wong
    [J]. Neural Computing and Applications, 2012, 21 : 1709 - 1716
  • [2] Decouple implementation of weight decay for recursive least square
    Leung, Andrew Chi-Sing
    Xiao, Yi
    Xu, Yong
    Wong, Kwok-Wo
    [J]. NEURAL COMPUTING & APPLICATIONS, 2012, 21 (07): : 1709 - 1716
  • [3] FPGA Implementation for A Recursive Least Square Algorithm
    Peng Liang
    Sun Guocang
    Deng Haihua
    Chen Ming
    [J]. 2013 2ND INTERNATIONAL SYMPOSIUM ON INSTRUMENTATION AND MEASUREMENT, SENSOR NETWORK AND AUTOMATION (IMSNA), 2013, : 741 - 744
  • [4] Convergence and stability of recursive damped least square algorithm
    Zengqiang C.
    Maoqiong L.
    Zhuzhi Y.
    [J]. Applied Mathematics and Mechanics, 2000, 21 (2) : 237 - 242
  • [5] CONVERGENCE AND STABILITY OF RECURSIVE DAMPED LEAST SQUARE ALGORITHM
    陈增强
    林茂琼
    袁著祉
    [J]. Applied Mathematics and Mechanics(English Edition), 2000, (02) : 237 - 242
  • [6] Convergence and stability of recursive damped least square algorithm
    Chen, ZQ
    Lin, MQ
    Yuan, ZZ
    [J]. APPLIED MATHEMATICS AND MECHANICS-ENGLISH EDITION, 2000, 21 (02) : 237 - 242
  • [7] Adaptive PLL Method using Recursive Least Square Algorithm
    Seok-Hwan, Moon
    Ji-Won, Kim
    Byung-Gun, Park
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON INDUSTRIAL TECHNOLOGY (ICIT), 2015, : 896 - 901
  • [8] Numerical integration approach based on recursive least square algorithm
    Deng, Musheng
    Zeng, Zhezhao
    Wu, Haibo
    [J]. Journal of Computational Information Systems, 2010, 6 (11): : 3695 - 3702
  • [9] A recursive least square algorithm for active control of mixed noise
    Wu, Lifu
    Qiu, Xiaojun
    Burnett, Ian S.
    Guo, Yecai
    [J]. JOURNAL OF SOUND AND VIBRATION, 2015, 339 : 1 - 10
  • [10] A robust recursive least square algorithm against impulsive noise
    Baek, SJ
    Kim, J
    Kim, DJ
    Har, DS
    Kim, K
    [J]. IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2004, E87A (09): : 2463 - 2465