Robust stochastic configuration networks with maximum correntropy criterion for uncertain data regression

被引:46
|
作者
Li, Ming [1 ,3 ]
Huang, Changqin [1 ,2 ]
Wang, Dianhui [3 ,4 ]
机构
[1] South China Normal Univ, Sch Informat Technol Educ, Guangzhou, Guangdong, Peoples R China
[2] South China Normal Univ, Guangdong Engn Res Ctr Smart Learning, Guangzhou, Guangdong, Peoples R China
[3] La Trobe Univ, Dept Comp Sci & Informat Technol, Melbourne, Vic 3086, Australia
[4] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang, Liaoning, Peoples R China
基金
中国博士后科学基金;
关键词
Stochastic configuration networks; Robust data regression; Randomized algorithms; Maximum correntropy criterion; Alternating optimization; FUNCTION APPROXIMATION; LEARNING ALGORITHM;
D O I
10.1016/j.ins.2018.09.026
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper develops a robust stochastic configuration network (RSCN) framework to cope with data modelling problems when the given samples contain noises or outliers. Technically, RSCNs are built by generalizing the objective function used in our original stochastic configuration networks with maximum correntropy criterion (MCC) induced losses (the proposed algorithm is termed as RSC-MCC). The half-quadratic (HQ) technique is employed to optimize the penalty weights for each training sample, aiming to weaken the impacts caused by the noisy data or outliers throughout the training session. Alternating optimization (AO) methodology is used to renew the RSCN model in company with updated penalty weights determined by HQ methods. The performance of RSC-MCC algorithm is compared with some existing methods, such as the probabilistic robust learning algorithm for neural networks with random weights (PRNNRW), RVFL networks, improved RVFL networks (Imp-RVFL), and our recent work RSCNs with kernel density estimation (RSC-KDE), on two synthetic function approximation examples, four benchmark datasets and one educational data modelling case study (for student learning performance prediction). The experimental results show that RSC-MCC performs more favourably in robust data analytics, and further indicate that our proposed RSCN framework (both RSC-KDE and RSC-MCC) has a good potential for real-world applications. (C) 2018 Elsevier Inc. All rights reserved.
引用
收藏
页码:73 / 86
页数:14
相关论文
共 50 条
  • [31] Robust Ellipse Fitting With Laplacian Kernel Based Maximum Correntropy Criterion
    Hu, Chenlong
    Wang, Gang
    Ho, K. C.
    Liang, Junli
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3127 - 3141
  • [32] New Robust Metric Learning Model Using Maximum Correntropy Criterion
    Xu, Jie
    Luo, Lei
    Deng, Cheng
    Huang, Heng
    [J]. KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, : 2555 - 2564
  • [33] An Accurate and Robust Gaze Estimation Method Based on Maximum Correntropy Criterion
    Yang, Ben
    Zhang, Xuetao
    Li, Zhongchang
    Du, Shaoyi
    Wang, Fei
    [J]. IEEE ACCESS, 2019, 7 : 23291 - 23302
  • [34] Robust sparse nonnegative matrix factorization based on maximum correntropy criterion
    Peng, Siyuan
    Ser, Wee
    Lin, Zhiping
    Chen, Badong
    [J]. 2018 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2018,
  • [35] Robust Constrained Generalized Correntropy and Maximum Versoria Criterion Adaptive Filters
    Bhattacharjee, Sankha Subhra
    Shaikh, Mohammed Aasim
    Kumar, Krishna
    George, Nithin V.
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2021, 68 (08) : 3002 - 3006
  • [36] Robust TDOA localization based on maximum correntropy criterion with variable center
    Wang, Wei
    Wang, Gang
    Ho, K. C.
    Huang, Lei
    [J]. SIGNAL PROCESSING, 2023, 205
  • [37] A Robust Generalized Maximum Correntropy Criterion Algorithm for Active Noise Control
    Zhu, Yingying
    Zhao, Haiquan
    [J]. IFAC PAPERSONLINE, 2019, 52 (24): : 299 - 303
  • [38] Maximum Correntropy Criterion With Variable Center for Robust Passive Multistatic Localization
    Hu, Keyuan
    Xiong, Wenxin
    He, Jiajun
    Leung, Chi-Sing
    So, Hing Cheung
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2023, 30 : 1407 - 1411
  • [39] Robust Sparse Channel Estimation Based on Maximum Mixture Correntropy Criterion
    Lu, Mingfei
    Xing, Lei
    Zheng, Nanning
    Chen, Badong
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [40] Robust State Estimation Based on Orthogonal Methods and Maximum Correntropy Criterion
    Freitas, Victor
    Coasta, Antonio Simoes
    Miranda, Vladimiro
    [J]. 2017 IEEE MANCHESTER POWERTECH, 2017,