Design of Extreme Learning Machine with Smoothedl0Regularization

被引：3
|
作者：
Yang, Cuili [1 ]
Nie, Kaizhe [1 ]
Qiao, Junfei [1 ]
Li, Bing [2 ]
机构：
[1] Beijing Univ Technol, Fac Informat Technol, Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China
[2] Wuhan Univ Technol, Sch Econ, Wuhan 430070, Peoples R China
来源：
MOBILE NETWORKS & APPLICATIONS | 2020年 / 25卷 / 06期
基金：
中国国家自然科学基金;
关键词：
Extreme learning machine; Sparsity; l(0)regularization; Network compactness; REGULARIZATION; LARS; ELM;
D O I：
10.1007/s11036-020-01587-3
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
In extreme learning machine (ELM), a large number of hidden nodes are required due to the randomly generated hidden layer. To improve network compactness, the ELM with smoothedl(0)regularizer (ELM-SL0 for short) is studied in this paper. Firstly, thel(0)regularization penalty term is introduced into the conventional error function, such that the unimportant output weights are gradually forced to zeros. Secondly, the batch gradient method and the smoothedl(0)regularizer are combined for training and pruning ELM. Furthermore, both the weak convergence and strong convergence of ELM-SL0 are investigated. Compared with other existing ELMs, the proposed algorithm obtains better performance in terms of estimation accuracy and network sparsity.
引用
收藏
页码：2434 / 2446
页数：13
相关论文
共 50 条
  • [41] Prototype Regularized Manifold Regularization Technique for Semi-Supervised Online Extreme Learning Machine
    Shah, Muhammad Zafran Muhammad Zaly
    Zainal, Anazida
    Ghaleb, Fuad A.
    Al-Qarafi, Abdulrahman
    Saeed, Faisal
    SENSORS, 2022, 22 (09)
  • [42] Improved Ozone Pollution Prediction Using Extreme Learning Machine with Tribas Regularization Activation Function
    Ismail, Noraini
    Othman, Zulaiha Ali
    INTELLIGENT AND INTERACTIVE COMPUTING, 2019, 67 : 151 - 165
  • [43] Face Recognition using Graph Extreme Learning Machine with L21-norm Regularization
    Abd Shehab, Mohanad
    Kahraman, Nihan
    Bilgin, Gokhan
    2017 10TH INTERNATIONAL CONFERENCE ON ELECTRICAL AND ELECTRONICS ENGINEERING (ELECO), 2017, : 881 - 884
  • [44] Multiple-kernel-learning-based extreme learning machine for classification design
    Li, Xiaodong
    Mao, Weijie
    Jiang, Wei
    NEURAL COMPUTING & APPLICATIONS, 2016, 27 (01): : 175 - 184
  • [45] Multiple-kernel-learning-based extreme learning machine for classification design
    Xiaodong Li
    Weijie Mao
    Wei Jiang
    Neural Computing and Applications, 2016, 27 : 175 - 184
  • [46] Extreme Learning Machine - A New Machine Learning Paradigm
    Perfilieva, Irina
    INTELLIGENT AND FUZZY SYSTEMS, INFUS 2024 CONFERENCE, VOL 1, 2024, 1088 : 7 - 10
  • [47] Design of PSS for multi-machine system using extreme learning machine algorithm
    Suman, M.
    Rao, M. Venu Gopala
    Veerendra, A. S.
    Mopidevi, Subbarao
    Marquez, Fausto Pedro Garcia
    MEASUREMENT, 2025, 247
  • [48] Regularization of Sequence Data for Machine Learning
    Bai, Bryan
    Kremer, Stefan C.
    2011 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE WORKSHOPS, 2011, : 19 - 25
  • [49] Learning to Rank with Extreme Learning Machine
    Zong, Weiwei
    Huang, Guang-Bin
    NEURAL PROCESSING LETTERS, 2014, 39 (02) : 155 - 166
  • [50] Learning to Rank with Extreme Learning Machine
    Weiwei Zong
    Guang-Bin Huang
    Neural Processing Letters, 2014, 39 : 155 - 166
12345