Distributed kernel gradient descent algorithm for minimum error entropy principle

被引：33
|
作者：
Hu, Ting [1 ]
Wu, Qiang [2 ]
Zhou, Ding-Xuan [3 ,4 ]
机构：
[1] Wuhan Univ, Sch Math & Stat, Wuhan 430072, Peoples R China
[2] Middle Tennessee State Univ, Dept Math Sci, Murfreesboro, TN 37132 USA
[3] City Univ Hong Kong, Sch Data Sci, Kowloon, Hong Kong, Peoples R China
[4] City Univ Hong Kong, Dept Math, Kowloon, Hong Kong, Peoples R China
来源：
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS | 2020年 / 49卷 / 01期
基金：
中国国家自然科学基金;
关键词：
Distributed learning; Minimum error entropy; Gradient descent algorithm; Kernel method; CRITERION;
D O I：
10.1016/j.acha.2019.01.002
中图分类号：
O29 [应用数学];
学科分类号：
070104 ;
摘要：
Distributed learning based on the divide and conquer approach is a powerful tool for big data processing. We introduce a distributed kernel gradient descent algorithm for the minimum error entropy principle and analyze its convergence. We show that the L-2 error decays at a minimax optimal rate under some mild conditions. As a tool we establish some concentration inequalities for U-statistics which play pivotal roles in our error analysis. Published by Elsevier Inc.
引用
收藏
页码：229 / 256
页数：28
相关论文
共 50 条
  • [1] Convergence of Gradient Descent for Minimum Error Entropy Principle in Linear Regression
    Hu, Ting
    Wu, Qiang
    Zhou, Ding-Xuan
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2016, 64 (24) : 6571 - 6579
  • [2] Kernel minimum error entropy algorithm
    Chen, Badong
    Yuan, Zejian
    Zheng, Nanning
    Principe, Jose C.
    [J]. NEUROCOMPUTING, 2013, 121 : 160 - 169
  • [3] Quantized kernel recursive minimum error entropy algorithm
    Jiang, Wang
    Gao, Yuyi
    He, Yue
    Chen, Shanmou
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 121
  • [4] Semi-Supervised Minimum Error Entropy Principle with Distributed Method
    Wang, Baobin
    Hu, Ting
    [J]. ENTROPY, 2018, 20 (12)
  • [5] MINIMUM ENTROPY OF ERROR PRINCIPLE IN ESTIMATION
    JANZURA, M
    KOSKI, T
    OTAHAL, A
    [J]. INFORMATION SCIENCES, 1994, 79 (1-2) : 123 - 144
  • [6] Distributed Minimum Error Entropy Algorithms
    Guo, Xin
    Hu, Ting
    Wu, Qiang
    [J]. JOURNAL OF MACHINE LEARNING RESEARCH, 2020, 21
  • [7] Distributed minimum error entropy algorithms
    Guo, Xin
    Hu, Ting
    Wu, Qiang
    [J]. Journal of Machine Learning Research, 2020, 21
  • [8] Distributed Kernel-Based Gradient Descent Algorithms
    Shao-Bo Lin
    Ding-Xuan Zhou
    [J]. Constructive Approximation, 2018, 47 : 249 - 276
  • [9] Distributed Kernel-Based Gradient Descent Algorithms
    Lin, Shao-Bo
    Zhou, Ding-Xuan
    [J]. CONSTRUCTIVE APPROXIMATION, 2018, 47 (02) : 249 - 276
  • [10] Regularization schemes for minimum error entropy principle
    Hu, Ting
    Fan, Jun
    Wu, Qiang
    Zhou, Ding-Xuan
    [J]. ANALYSIS AND APPLICATIONS, 2015, 13 (04) : 437 - 455
12345