Mixture correntropy for robust learning

被引:124
|
作者
Chen, Badong [1 ]
Wang, Xin [1 ]
Lu, Na [1 ]
Wang, Shiyuan [2 ]
Cao, Jiuwen [3 ]
Qin, Jing [4 ]
机构
[1] Xi An Jiao Tong Univ, Sch Elect & Informat Engn, Xian 710049, Shaanxi, Peoples R China
[2] Southwest Univ, Coll Elect & Informat Engn, Chongqing 400715, Peoples R China
[3] Hangzhou Dianzi Univ, Inst Informat & Control, Hangzhou 310018, Zhejiang, Peoples R China
[4] Hong Kong Polytech Univ, Sch Nursing, Ctr Smart Hlth, Hong Kong, Hong Kong, Peoples R China
基金
国家重点研发计划;
关键词
Correntropy; Mixture correntropy; Robust learning; Extreme learning machine; Kernel adaptive filtering; MACHINE; REGRESSION;
D O I
10.1016/j.patcog.2018.02.010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Correntropy is a local similarity measure defined in kernel space, hence can combat large outliers in robust signal processing and machine learning. So far, many robust learning algorithms have been developed under the maximum correntropy criterion (MCC), among which, a Gaussian kernel is generally used in correntropy. To further improve the learning performance, in this paper we propose the concept of mixture correntropy, which uses the mixture of two Gaussian functions as the kernel function. Some important properties of the mixture correntropy are presented. Applications of the maximum mixture correntropy criterion (MMCC) to extreme learning machine (ELM) and kernel adaptive filtering (KAF) for function approximation and data regression are also studied. Experimental results show that the learning algorithms under MMCC can perform very well and achieve better performance than the conventional MCC based algorithms as well as several other state-of-the-art algorithms. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:318 / 327
页数:10
相关论文
共 50 条
  • [1] Mixture correntropy-based robust distance metric learning for classification
    Yuan, Chao
    Zhou, Changsheng
    Peng, Jigen
    Li, Haiyang
    [J]. KNOWLEDGE-BASED SYSTEMS, 2024, 295
  • [2] A robust classification framework with mixture correntropy
    Wang, Yidan
    Yang, Liming
    Ren, Qiangqiang
    [J]. INFORMATION SCIENCES, 2019, 491 : 306 - 318
  • [3] Multikernel Correntropy for Robust Learning
    Chen, Badong
    Xie, Yuqing
    Wang, Xin
    Yuan, Zejian
    Ren, Pengju
    Qin, Jing
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (12) : 13500 - 13511
  • [4] Outlier-robust Kalman filters with mixture correntropy
    Wang, Hongwei
    Zhang, Wei
    Zuo, Junyi
    Wang, Heping
    [J]. JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2020, 357 (08): : 5058 - 5072
  • [5] A ROBUST MAXIMUM CORRENTROPY CRITERION FOR DICTIONARY LEARNING
    Loza, Carlos A.
    Principe, Jose C.
    [J]. 2016 IEEE 26TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING (MLSP), 2016,
  • [6] Robust Sparse Channel Estimation Based on Maximum Mixture Correntropy Criterion
    Lu, Mingfei
    Xing, Lei
    Zheng, Nanning
    Chen, Badong
    [J]. 2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [7] Quantized Kernel Learning Filter with Maximum Mixture Correntropy Criterion
    Chu, Lin
    Li, Wenling
    [J]. PROCEEDINGS OF 2019 CHINESE INTELLIGENT AUTOMATION CONFERENCE, 2020, 586 : 647 - 655
  • [8] Mixture Correntropy-Based Kernel Extreme Learning Machines
    Zheng, Yunfei
    Chen, Badong
    Wang, Shiyuan
    Wang, Weiqun
    Qin, Wei
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (02) : 811 - 825
  • [9] Maximum mixture correntropy based outlier-robust nonlinear filter and smoother
    Lu, Chunguang
    Feng, Weike
    Zhang, Yongshun
    Li, Zhihui
    [J]. SIGNAL PROCESSING, 2021, 188
  • [10] ROBUST FEATURE LEARNING BY STACKED AUTOENCODER WITH MAXIMUM CORRENTROPY CRITERION
    Qi, Yu
    Wang, Yueming
    Zheng, Xiaoxiang
    Wu, Zhaohui
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,