REGULARIZED KERNEL NETWORKS WITH CONVEX P-LIPSCHITZ LOSS

被引:0
|
作者
Pan, Weishan [1 ]
Sun, Hongwei [1 ]
机构
[1] Univ Jinan, Sch Math Sci, Jinan 250022, Peoples R China
基金
中国国家自然科学基金;
关键词
Learning theory; regularized kernel network; leave one out analysis; error bound; learning rate; CONDITIONAL QUANTILES; LEARNING RATES; REGRESSION;
D O I
10.3934/mfc.2023049
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
.We propose a loss function class called convex p-Lipschitz loss functions, which includes hinge loss, pinball loss and least square loss and so on. For regularized kernel networks and bias corrected regularized kernel networks with general convex pLipschitz loss, we establish the error analysis frameworks by employing the leave one out technique [16]. Under a mild source condition which describes how the minimizer f* of the generalization error can be approximated by the hypothesis space HK, satisfying error bounds and learning rates are deduced. Moreover, our proofs also show that bias correction method can indeed decrease the learning error.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Pay attention to your loss: understanding misconceptions about 1-Lipschitz neural networks
    Bethune, Louis
    Boissin, Thibaut
    Serrurier, Mathieu
    Mamalet, Franck
    Friedrich, Corentin
    Gonzalez-Sanz, Alberto
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [32] Path loss estimation in wireless networks using partial derivative based convex optimisation method
    Mehta, Ridhima
    International Journal of Autonomous and Adaptive Communications Systems, 2020, 13 (03): : 229 - 245
  • [33] Strictly convex loss functions for port-Hamiltonian based optimization algorithm for MTDC networks
    Benedito, Ernest
    del Puerto-Flores, Dunstano
    Doria-Cerezo, Arnau
    van der Feltz, Olivier
    Scherpen, Jacquelien M. A.
    2016 IEEE 55TH CONFERENCE ON DECISION AND CONTROL (CDC), 2016, : 7483 - 7488
  • [35] Kernel risk-sensitive mean p-power loss based hyper-graph regularized robust extreme learning machine and its semi-supervised extension for sample classification
    Zhen-Xin Niu
    Cui-Na Jiao
    Liang-Rui Ren
    Rong Zhu
    Juan Wang
    Jin-Xing Liu
    Applied Intelligence, 2022, 52 : 8572 - 8587
  • [36] Kernel risk-sensitive mean p-power loss based hyper-graph regularized robust extreme learning machine and its semi-supervised extension for sample classification
    Niu, Zhen-Xin
    Jiao, Cui-Na
    Ren, Liang-Rui
    Zhu, Rong
    Wang, Juan
    Liu, Jin-Xing
    APPLIED INTELLIGENCE, 2022, 52 (08) : 8572 - 8587
  • [37] Minimum kernel risk sensitive mean p-power loss algorithms and their performance analysis
    Zhang, Tao
    Huang, Xuewei
    Wang, Shiyuan
    DIGITAL SIGNAL PROCESSING, 2020, 104 (104)
  • [38] Diffusion adagrad minimum kernel risk sensitive mean p-power loss algorithm
    Peng, Lina
    Zhang, Tao
    Wang, Shiyuan
    Huang, Gangyi
    Chen, Shanmou
    SIGNAL PROCESSING, 2023, 202
  • [39] A Robust Diffusion Minimum Kernel Risk-Sensitive Loss Algorithm over Multitask Sensor Networks
    Li, Xinyu
    Shi, Qing
    Xiao, Shuangyi
    Duan, Shukai
    Chen, Feng
    SENSORS, 2019, 19 (10):
  • [40] Complex multi-kernel random Fourier adaptive algorithms under the complex kernel risk-sensitive p-power loss
    Huang, Gangyi
    Shen, Minglin
    Zhang, Tao
    He, Fuliang
    Wang, Shiyuan
    Digital Signal Processing: A Review Journal, 2021, 115