Enhanced Extreme Learning Machine with Modified Gram-Schmidt Algorithm

被引:0
|
作者
Yin, Jianchuan [1 ]
Wang, Nini [2 ]
机构
[1] Dalian Maritime Univ, Coll Nav, 1 Linghai Rd, Dalian 116026, Peoples R China
[2] Dalian Maritime Univ, Dept Math, Dalian 116026, Peoples R China
关键词
Extreme learning machine (ELM); Modified Gram-Schmidt algorithm (MGS); Feedforward neural networks; FEEDFORWARD NETWORKS; IDENTIFICATION;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Extreme learning machine (ELM) has shown to be extremely fast with better generalization performance. However, the implementation of ELM encounters two problems. First; ELM tends to require more hidden nodes than conventional tuning-based algorithms. Second, subjectivity is involved ill choosing hidden nodes number. In this paper, we apply the modified Gram-Schmidt (MGS) method to select; hidden nodes which maximize the increment to explained variance of the desired output. The Akaike's final prediction error (FEE) criterion are used to automatically determine the number of hidden nodes. In comparison with conventional ELM learning method on several commonly used regressor benchmark problems. our proposed algorithm can achieve compact network with much faster response and satisfactory accuracy.
引用
收藏
页码:381 / +
页数:2
相关论文
共 50 条
  • [1] Modified Gram-Schmidt Algorithm for Extreme Learning Machine
    Yin, Jianchuan
    Dong, Fang
    Wang, Nini
    [J]. SECOND INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN, VOL 2, PROCEEDINGS, 2009, : 517 - +
  • [2] Modified bidirectional extreme learning machine with Gram-Schmidt orthogonalization method
    Zeng, Guoqiang
    Zhang, Baihai
    Yao, Fenxi
    Chai, Senchun
    [J]. NEUROCOMPUTING, 2018, 316 : 405 - 414
  • [3] Gram-Schmidt process based incremental extreme learning machine
    Zhao, Yong-Ping
    Li, Zhi-Qiang
    Xi, Peng-Peng
    Liang, Dong
    Sun, Liguo
    Chen, Ting-Hao
    [J]. NEUROCOMPUTING, 2017, 241 : 1 - 17
  • [4] On growth factors of the modified Gram-Schmidt algorithm
    Wei, Musheng
    Liu, Qiaohua
    [J]. NUMERICAL LINEAR ALGEBRA WITH APPLICATIONS, 2008, 15 (07) : 621 - 636
  • [5] MODIFIED GRAM-SCHMIDT PROCESS VS CLASSICAL GRAM-SCHMIDT
    LONGLEY, JW
    [J]. COMMUNICATIONS IN STATISTICS PART B-SIMULATION AND COMPUTATION, 1981, 10 (05): : 517 - 527
  • [6] LOSS AND RECAPTURE OF ORTHOGONALITY IN THE MODIFIED GRAM-SCHMIDT ALGORITHM
    BJORCK, A
    PAIGE, CC
    [J]. SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 1992, 13 (01) : 176 - 190
  • [7] A robust criterion for the modified Gram-Schmidt algorithm with selective reorthogonalization
    Giraud, L
    Langou, J
    [J]. SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2003, 25 (02): : 417 - 441
  • [8] A modified Gram-Schmidt algorithm with iterative orthogonalization and column pivoting
    Dax, A
    [J]. LINEAR ALGEBRA AND ITS APPLICATIONS, 2000, 310 (1-3) : 25 - 42
  • [9] A NOTE ON THE MODIFIED GRAM-SCHMIDT PROCESS
    SREEDHARAN, VP
    [J]. INTERNATIONAL JOURNAL OF COMPUTER MATHEMATICS, 1988, 24 (3-4) : 277 - 290
  • [10] RECURSIVE MODIFIED GRAM-SCHMIDT ALGORITHM FOR LINEAR-PHASE FILTERING
    SUNWOO, JS
    UN, CK
    [J]. SIGNAL PROCESSING, 1991, 22 (01) : 43 - 51