Training extreme learning machine via regularized correntropy criterion

被引:3
|
作者
Hong-Jie Xing
Xin-Mei Wang
机构
[1] Hebei University,Key Laboratory of Machine Learning and Computational Intelligence, College of Mathematics and Computer Science
[2] Hebei University,College of Mathematics and Computer Science
来源
关键词
Extreme learning machine; Correntropy; Regularization term; Half-quadratic optimization;
D O I
暂无
中图分类号
学科分类号
摘要
In this paper, a regularized correntropy criterion (RCC) for extreme learning machine (ELM) is proposed to deal with the training set with noises or outliers. In RCC, the Gaussian kernel function is utilized to substitute Euclidean norm of the mean square error (MSE) criterion. Replacing MSE by RCC can enhance the anti-noise ability of ELM. Moreover, the optimal weights connecting the hidden and output layers together with the optimal bias terms can be promptly obtained by the half-quadratic (HQ) optimization technique with an iterative manner. Experimental results on the four synthetic data sets and the fourteen benchmark data sets demonstrate that the proposed method is superior to the traditional ELM and the regularized ELM both trained by the MSE criterion.
引用
收藏
页码:1977 / 1986
页数:9
相关论文
共 50 条
  • [41] A fast and efficient conformal regressor with regularized extreme learning machine
    Wang, Di
    Wang, Ping
    Shi, Junzhi
    [J]. NEUROCOMPUTING, 2018, 304 : 1 - 11
  • [42] Robust feature extraction for novelty detection based on regularized correntropy criterion
    Ren, Huan-Ru
    Xing, Hong-Jie
    [J]. PROCEEDINGS 2012 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2012, : 975 - 980
  • [43] Novel Statistical Regularized Extreme Learning Algorithm to Address the Multicollinearity in Machine Learning
    Yildirim, Hasan
    [J]. IEEE ACCESS, 2024, 12 : 102355 - 102367
  • [44] MAXIMUM CORRENTROPY CRITERION FOR DISCRIMINATIVE DICTIONARY LEARNING
    Hao, Pengyi
    Kamata, Sei-ichiro
    [J]. 2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 4325 - 4329
  • [45] Compressed training based on extreme learning machine
    Castro F.M.
    Jojoa P.E.
    [J]. Informacion Tecnologica, 2019, 30 (04): : 227 - 236
  • [46] Noise Resistant Training for Extreme Learning Machine
    Lui, Yik Lam
    Wong, Hiu Tung
    Leung, Chi-Sing
    Kwong, Sam
    [J]. ADVANCES IN NEURAL NETWORKS, PT II, 2017, 10262 : 257 - 265
  • [47] A ROBUST MAXIMUM CORRENTROPY CRITERION FOR DICTIONARY LEARNING
    Loza, Carlos A.
    Principe, Jose C.
    [J]. 2016 IEEE 26TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2016,
  • [48] Correntropy Extreme Learning Machine Based on Spatial Pyramid Matching and Local Receptive Field
    Liu Bin
    Liu Jing
    Wu Chao
    Yang Youheng
    [J]. JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2021, 43 (08) : 2343 - 2351
  • [49] Regularized ensemble neural networks models in the Extreme Learning Machine framework
    Perales-Gonzalez, Carlos
    Carbonero-Ruz, Mariano
    Becerra-Alonso, David
    Perez-Rodriguez, Javier
    Fernandez-Navarro, Francisco
    [J]. NEUROCOMPUTING, 2019, 361 : 196 - 211
  • [50] C-Loss-Based Doubly Regularized Extreme Learning Machine
    Wu, Qing
    Fu, Yan-Lin
    Cui, Dong-Shun
    Wang, En
    [J]. COGNITIVE COMPUTATION, 2023, 15 (02) : 496 - 519