Mixture correntropy for robust learning

被引:124
|
作者
Chen, Badong [1 ]
Wang, Xin [1 ]
Lu, Na [1 ]
Wang, Shiyuan [2 ]
Cao, Jiuwen [3 ]
Qin, Jing [4 ]
机构
[1] Xi An Jiao Tong Univ, Sch Elect & Informat Engn, Xian 710049, Shaanxi, Peoples R China
[2] Southwest Univ, Coll Elect & Informat Engn, Chongqing 400715, Peoples R China
[3] Hangzhou Dianzi Univ, Inst Informat & Control, Hangzhou 310018, Zhejiang, Peoples R China
[4] Hong Kong Polytech Univ, Sch Nursing, Ctr Smart Hlth, Hong Kong, Hong Kong, Peoples R China
基金
国家重点研发计划;
关键词
Correntropy; Mixture correntropy; Robust learning; Extreme learning machine; Kernel adaptive filtering; MACHINE; REGRESSION;
D O I
10.1016/j.patcog.2018.02.010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Correntropy is a local similarity measure defined in kernel space, hence can combat large outliers in robust signal processing and machine learning. So far, many robust learning algorithms have been developed under the maximum correntropy criterion (MCC), among which, a Gaussian kernel is generally used in correntropy. To further improve the learning performance, in this paper we propose the concept of mixture correntropy, which uses the mixture of two Gaussian functions as the kernel function. Some important properties of the mixture correntropy are presented. Applications of the maximum mixture correntropy criterion (MMCC) to extreme learning machine (ELM) and kernel adaptive filtering (KAF) for function approximation and data regression are also studied. Experimental results show that the learning algorithms under MMCC can perform very well and achieve better performance than the conventional MCC based algorithms as well as several other state-of-the-art algorithms. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:318 / 327
页数:10
相关论文
共 50 条
  • [21] Generalized multikernel correntropy based broad learning system for robust regression
    Zheng, Yunfei
    Wang, Shiyuan
    Chen, Badong
    [J]. INFORMATION SCIENCES, 2024, 678
  • [22] Learning with correntropy-induced losses for regression with mixture of symmetric stable noise
    Feng, Yunlong
    Ying, Yiming
    [J]. APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2020, 48 (02) : 795 - 810
  • [23] A Robust DOA Estimator Based on Maximum Mixture Complex Correntropy for Noisy Input and Impulsive Noise
    Zhao, Haiquan
    Luo, Wenjing
    Xu, Wenjing
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2024, 71 (07) : 3588 - 3592
  • [24] Robust learning algorithm for the mixture of experts
    Allende, H
    Torres, R
    Salas, R
    Moraga, C
    [J]. PATTERN RECOGNITION AND IMAGE ANALYSIS, PROCEEDINGS, 2003, 2652 : 19 - 27
  • [25] Mixture Complex Correntropy for Adaptive Filter
    Qian, Guobing
    Ning, Xiaohan
    Wang, Shiyuan
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2019, 66 (08) : 1476 - 1480
  • [26] Stacking integrated learning model via ELM and GRU with mixture correntropy loss for robust state of health estimation of lithium-ion batteries
    Xue, Jingsong
    Ma, Wentao
    Feng, Xiaoyang
    Guo, Peng
    Guo, Yaosong
    Hu, Xianzhi
    Chen, Badong
    [J]. ENERGY, 2023, 284
  • [27] Online sparse correntropy kernel learning for outlier-robust system identification
    Duarte, Michael S.
    Barreto, Guilherme A.
    [J]. IFAC PAPERSONLINE, 2019, 52 (01): : 430 - 435
  • [28] Robust Subband Adaptive Filter Algorithms-Based Mixture Correntropy and Application to Acoustic Echo Cancellation
    Zhao, Haiquan
    Gao, Yuan
    Zhu, Yingying
    [J]. IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2023, 31 : 1223 - 1233
  • [29] Robust Maximum Mixture Correntropy Criterion-Based Semi-Supervised ELM With Variable Center
    Yang, Jie
    Cao, Jiuwen
    Xue, Anke
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2020, 67 (12) : 3572 - 3576
  • [30] Asymmetric Correntropy for Robust Adaptive Filtering
    Chen, Badong
    Xie, Yuqing
    Li, Zhuang
    Li, Yingsong
    Ren, Pengju
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2022, 69 (03) : 1922 - 1926