Robust stochastic configuration networks with maximum correntropy criterion for uncertain data regression

被引:46
|
作者
Li, Ming [1 ,3 ]
Huang, Changqin [1 ,2 ]
Wang, Dianhui [3 ,4 ]
机构
[1] South China Normal Univ, Sch Informat Technol Educ, Guangzhou, Guangdong, Peoples R China
[2] South China Normal Univ, Guangdong Engn Res Ctr Smart Learning, Guangzhou, Guangdong, Peoples R China
[3] La Trobe Univ, Dept Comp Sci & Informat Technol, Melbourne, Vic 3086, Australia
[4] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang, Liaoning, Peoples R China
基金
中国博士后科学基金;
关键词
Stochastic configuration networks; Robust data regression; Randomized algorithms; Maximum correntropy criterion; Alternating optimization; FUNCTION APPROXIMATION; LEARNING ALGORITHM;
D O I
10.1016/j.ins.2018.09.026
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper develops a robust stochastic configuration network (RSCN) framework to cope with data modelling problems when the given samples contain noises or outliers. Technically, RSCNs are built by generalizing the objective function used in our original stochastic configuration networks with maximum correntropy criterion (MCC) induced losses (the proposed algorithm is termed as RSC-MCC). The half-quadratic (HQ) technique is employed to optimize the penalty weights for each training sample, aiming to weaken the impacts caused by the noisy data or outliers throughout the training session. Alternating optimization (AO) methodology is used to renew the RSCN model in company with updated penalty weights determined by HQ methods. The performance of RSC-MCC algorithm is compared with some existing methods, such as the probabilistic robust learning algorithm for neural networks with random weights (PRNNRW), RVFL networks, improved RVFL networks (Imp-RVFL), and our recent work RSCNs with kernel density estimation (RSC-KDE), on two synthetic function approximation examples, four benchmark datasets and one educational data modelling case study (for student learning performance prediction). The experimental results show that RSC-MCC performs more favourably in robust data analytics, and further indicate that our proposed RSCN framework (both RSC-KDE and RSC-MCC) has a good potential for real-world applications. (C) 2018 Elsevier Inc. All rights reserved.
引用
收藏
页码:73 / 86
页数:14
相关论文
共 50 条
  • [1] Robust stochastic configuration networks with kernel density estimation for uncertain data regression
    Wang, Dianhui
    Li, Ming
    [J]. INFORMATION SCIENCES, 2017, 412 : 210 - 222
  • [2] Robust Proximal Support Vector Regression Based on Maximum Correntropy Criterion
    Wang, Kuaini
    Pei, Huimin
    Ding, Xiaoshuai
    Zhong, Ping
    [J]. SCIENTIFIC PROGRAMMING, 2019, 2019
  • [3] A MAXIMUM CORRENTROPY CRITERION FOR ROBUST MULTIDIMENSIONAL SCALING
    Mandanas, Fotios
    Kotropoulos, Constantine
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 1906 - 1910
  • [4] Maximum Correntropy Criterion for Robust Face Recognition
    He, Ran
    Zheng, Wei-Shi
    Hu, Bao-Gang
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (08) : 1561 - 1576
  • [5] A ROBUST MAXIMUM CORRENTROPY CRITERION FOR DICTIONARY LEARNING
    Loza, Carlos A.
    Principe, Jose C.
    [J]. 2016 IEEE 26TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2016,
  • [6] Recursive robust least squares support vector regression based on maximum correntropy criterion
    Chen, Xiaobo
    Yang, Jian
    Liang, Jun
    Ye, Qiaolin
    [J]. NEUROCOMPUTING, 2012, 97 : 63 - 73
  • [7] Maximum correntropy criterion based regression for multivariate calibration
    Peng, Jiangtao
    Guo, Lu
    Hu, Yong
    Rao, KaiFeng
    Xie, Qiwei
    [J]. CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2017, 161 : 27 - 33
  • [8] Learning with the Maximum Correntropy Criterion Induced Losses for Regression
    Feng, Yunlong
    Huang, Xiaolin
    Shi, Lei
    Yang, Yuning
    Suykens, Johan A. K.
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2015, 16 : 993 - 1034
  • [9] Robust Motion Averaging under Maximum Correntropy Criterion
    Zhu, Jihua
    Hu, Jie
    Lu, Huimin
    Chen, Badong
    Li, Zhongyu
    Li, Yaochen
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 5283 - 5288
  • [10] Maximum Correntropy Criterion Based Robust Kalman Filter
    Wang, Liansheng
    Gao, XingWei
    Yin, Lijian
    [J]. CHINA SATELLITE NAVIGATION CONFERENCE (CSNC) 2018 PROCEEDINGS, VOL III, 2018, 499 : 491 - 500