Tikhonov training of the CMAC neural network

被引:6
|
作者
Weruaga, Luis [1 ]
Kieslinger, Barbara
机构
[1] Austrian Acad Sci, Commiss Sci Visualizat, A-1220 Vienna, Austria
[2] Ctr Social Innovat, A-1150 Vienna, Austria
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2006年 / 17卷 / 03期
关键词
cerebellar model articulation controller (CMAC); generalization; overfitting; Tikhonov regularization;
D O I
10.1109/TNN.2006.872348
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The architecture of the cerebellar model articulation controller (CMAC) presents a rigid compromise between learning and generalization. In the presence of a sparse training dataset, this limitation manifestly causes overfitting, a drawback that is not overcome by current training algorithms. This paper proposes a novel training framework founded on the Tikhonov regularization, which relates to the minimization of the power of the sigma-order derivative. This smoothness criterion yields to an internal cell-interaction mechanism that increases the generalization beyond the degree hardcoded in the CMAC architecture while preserving the potential CMAC learning capabilities. The resulting training mechanism, which proves to be simple and computationally efficient, is deduced from a rigorous theoretical study. The performance of the new training framework is validated against comparative benchmarks from the DELVE environment.
引用
收藏
页码:613 / 622
页数:10
相关论文
共 50 条
  • [1] Active training on the CMAC neural network
    Weruaga, L
    [J]. 2004 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2004, : 855 - 860
  • [2] On the training of a multi-resolution CMAC neural network
    Menozzi, A
    Chow, MY
    [J]. IECON '97 - PROCEEDINGS OF THE 23RD INTERNATIONAL CONFERENCE ON INDUSTRIAL ELECTRONICS, CONTROL, AND INSTRUMENTATION, VOLS. 1-4, 1997, : 1130 - 1135
  • [3] On the training of a multi-resolution CMAC neural network
    Menozzi, A
    Chow, MY
    [J]. ISIE '97 - PROCEEDINGS OF THE IEEE INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS, VOLS 1-3, 1997, : 1201 - 1205
  • [4] Eigenanalysis of CMAC neural network
    Zhang, CS
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2005, PT 1, PROCEEDINGS, 2005, 3496 : 75 - 80
  • [5] Inverse training scheme for MS_CMAC neural network to handle random training data
    Jan, Jiun-Chi
    Chen, Chih-Ming
    Hsiao, Liang-Hao
    [J]. NEUROCOMPUTING, 2006, 70 (1-3) : 502 - 512
  • [6] A New Improved CMAC Neural Network
    Ge, Yingqi
    Luo, Xiaoping
    Du, Pengying
    [J]. 2010 CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-5, 2010, : 3271 - +
  • [7] CMAC neural network fuzzy control
    Shi, WX
    Zhou, FZ
    [J]. PROCEEDINGS OF THE 1996 IEEE IECON - 22ND INTERNATIONAL CONFERENCE ON INDUSTRIAL ELECTRONICS, CONTROL, AND INSTRUMENTATION, VOLS 1-3, 1996, : 584 - 589
  • [8] CMAC neural network fuzzy control
    Zhou, FZ
    Shi, WX
    [J]. RO-MAN '97 SENDAI: 6TH IEEE INTERNATIONAL WORKSHOP ON ROBOT AND HUMAN COMMUNICATION, PROCEEDINGS, 1997, : 236 - 241
  • [9] CMAC:: Reconsidering an old neural network
    Horváth, G
    [J]. INTELLIGENT CONTROL SYSTEMS AND SIGNAL PROCESSING 2003, 2003, : 165 - 170
  • [10] Basis Functions of the multidimensional CMAC neural network
    Avedyan, Eduard
    [J]. 2014 INTERNATIONAL CONFERENCE ON ENGINEERING AND TELECOMMUNICATION (EN&T 2014), 2014, : 63 - 66