The hidden neurons selection of the wavelet networks using support vector machines and ridge regression

被引:25
|
作者
Han, Min [1 ]
Yin, Jia [1 ]
机构
[1] Dalian Univ Technol, Sch Elect & Informat Engn, Dalian 116023, Peoples R China
关键词
Wavelet network; Support vector machine; Hidden neurons selection; Ridge regression;
D O I
10.1016/j.neucom.2007.12.009
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A 1-norm support vector machine stepwise (SVMS) algorithm is proposed for the hidden neurons selection of wavelet networks (WNs). In this new algorithm, the linear programming support vector machine (LPSVM) is employed to pre-select the hidden neurons, and then a stepwise selection algorithm based on ridge regression is introduced to select hidden neurons from the pre-selection. The main advantages of the new algorithm are that it can get rid of the influence of the ill conditioning of the matrix and deal with the problems that involve a great number of candidate neurons or a large size of samples. Four examples are provided to illustrate the efficiency of the new algorithm. (c) 2007 Elsevier B.V. All rights reserved.
引用
收藏
页码:471 / 479
页数:9
相关论文
共 50 条
  • [1] Enhancing Sparsity of Support Vector Machines by Ridge Regression
    Xia, Xiao-Lei
    Ouyang, Mingxing
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [2] Selection of Support Vector Machines Parameters for Regression Using Nested Grids
    Popov, Alexander
    Sautin, Alexander
    IFOST 2008: PROCEEDING OF THE THIRD INTERNATIONAL FORUM ON STRATEGIC TECHNOLOGIES, 2008, : 329 - 331
  • [3] Speech Recognition using Wavelet Packets, Neural Networks and Support Vector Machines
    Kulkarni, Purva
    Kulkarni, Saili
    Mulange, Sucheta
    Dand, Aneri
    Cheeran, Alice N.
    2014 INTERNATIONAL CONFERENCE ON SIGNAL PROPAGATION AND COMPUTER TECHNOLOGY (ICSPCT 2014), 2014, : 451 - 455
  • [4] Palmprint recognition using wavelet and support vector machines
    Zhou, Xinhong
    Peng, Yuhua
    Yang, Ming
    PRICAI 2006: TRENDS IN ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2006, 4099 : 385 - 393
  • [5] Image compression using wavelet support vector machines
    Li, Yuancheng
    Hit, Haitao
    ADVANCED INTELLIGENT COMPUTING THEORIES AND APPLICATIONS: WITH ASPECTS OF THEORETICAL AND METHODOLOGICAL ISSUES, 2007, 4681 : 922 - +
  • [6] Stock selection using Support Vector Machines
    Fan, A
    Palaniswami, M
    IJCNN'01: INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2001, : 1793 - 1798
  • [7] Support vector regression machines
    Drucker, H
    Burges, CJC
    Kaufman, L
    Smola, A
    Vapnik, V
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 9: PROCEEDINGS OF THE 1996 CONFERENCE, 1997, 9 : 155 - 161
  • [8] Rainfall Forecasting using Support Vector Regression Machines
    Velasco, Lemuel Clark
    Aca-ac, Johanne Miguel
    Cajes, Jeb Joseph
    Lactuan, Nove Joshua
    Chit, Suwannit Chareen
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (03) : 231 - 237
  • [9] Robust classification and regression using support vector machines
    Trafalis, Theodore B.
    Gilbert, Robin C.
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2006, 173 (03) : 893 - 909
  • [10] Hidden space support vector machines
    Zhang, L
    Zhou, WD
    Hao, LC
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2004, 15 (06): : 1424 - 1434