Training extreme learning machine via regularized correntropy criterion

被引:3
|
作者
Hong-Jie Xing
Xin-Mei Wang
机构
[1] Hebei University,Key Laboratory of Machine Learning and Computational Intelligence, College of Mathematics and Computer Science
[2] Hebei University,College of Mathematics and Computer Science
来源
关键词
Extreme learning machine; Correntropy; Regularization term; Half-quadratic optimization;
D O I
暂无
中图分类号
学科分类号
摘要
In this paper, a regularized correntropy criterion (RCC) for extreme learning machine (ELM) is proposed to deal with the training set with noises or outliers. In RCC, the Gaussian kernel function is utilized to substitute Euclidean norm of the mean square error (MSE) criterion. Replacing MSE by RCC can enhance the anti-noise ability of ELM. Moreover, the optimal weights connecting the hidden and output layers together with the optimal bias terms can be promptly obtained by the half-quadratic (HQ) optimization technique with an iterative manner. Experimental results on the four synthetic data sets and the fourteen benchmark data sets demonstrate that the proposed method is superior to the traditional ELM and the regularized ELM both trained by the MSE criterion.
引用
收藏
页码:1977 / 1986
页数:9
相关论文
共 50 条
  • [1] Training extreme learning machine via regularized correntropy criterion
    Xing, Hong-Jie
    Wang, Xin-Mei
    [J]. NEURAL COMPUTING & APPLICATIONS, 2013, 23 (7-8): : 1977 - 1986
  • [2] Online sequential regularized correntropy criterion extreme learning machine on spark streaming signal prediction for electronic device degradation
    Mei W.
    Gao Y.
    Du L.
    Liu Z.
    Wang H.
    [J]. Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument, 2019, 40 (11): : 212 - 224
  • [3] Online Sequential Extreme Learning Machine Algorithms Based on Maximum Correntropy Criterion
    Wang, Wenyue
    Shi, Chunfen
    Wang, Wanli
    Dang, Lujuan
    Wang, Shiyuan
    Duan, Shukai
    [J]. 2017 20TH INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), 2017, : 1092 - 1098
  • [4] Online Sequential Extreme Learning Machine Algorithm Based on the Generalized Maximum Correntropy Criterion
    Shi, Chunfen
    Wang, Wenyue
    Li, Hao
    Wang, Shiyuan
    [J]. PROCEEDINGS OF 2018 14TH IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP), 2018, : 162 - 166
  • [5] Regularized Extreme Learning Machine
    Deng, Wanyu
    Zheng, Qinghua
    Chen, Lin
    [J]. 2009 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DATA MINING, 2009, : 389 - 395
  • [6] Correntropy induced loss based sparse robust graph regularized extreme learning machine for cancer classification
    Ren, Liang-Rui
    Gao, Ying-Lian
    Liu, Jin-Xing
    Shang, Junliang
    Zheng, Chun-Hou
    [J]. BMC BIOINFORMATICS, 2020, 21 (01)
  • [7] Regularized Training of the Extreme Learning Machine using the Conjugate Gradient Method
    de Chazal, Philip
    McDonnell, Mark D.
    [J]. 2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 1802 - 1808
  • [8] Correntropy induced loss based sparse robust graph regularized extreme learning machine for cancer classification
    Liang-Rui Ren
    Ying-Lian Gao
    Jin-Xing Liu
    Junliang Shang
    Chun-Hou Zheng
    [J]. BMC Bioinformatics, 21
  • [9] Regularized maximum correntropy machine
    Wang, Jim Jing-Yan
    Wang, Yunji
    Jing, Bing-Yi
    Gao, Xin
    [J]. NEUROCOMPUTING, 2015, 160 : 85 - 92
  • [10] Manifold regularized extreme learning machine
    Liu, Bing
    Xia, Shi-Xiong
    Meng, Fan-Rong
    Zhou, Yong
    [J]. NEURAL COMPUTING & APPLICATIONS, 2016, 27 (02): : 255 - 269