A pruning algorithm with L1/2 regularizer for extreme learning machine

被引:0
|
作者
Ye-tian FAN [1 ]
Wei WU [1 ]
Wen-yu YANG [2 ]
Qin-wei FAN [1 ]
Jian WANG [1 ]
机构
[1] School of Mathematical Sciences,Dalian University of Technology
[2] College of Science,Huazhong Agricultural University
基金
中央高校基本科研业务费专项资金资助; 中国国家自然科学基金;
关键词
Extreme learning machine(ELM); L1/2; regularizer; Network pruning;
D O I
暂无
中图分类号
TP181 [自动推理、机器学习];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Compared with traditional learning methods such as the back propagation(BP)method,extreme learning machine provides much faster learning speed and needs less human intervention,and thus has been widely used.In this paper we combine the L1/2regularization method with extreme learning machine to prune extreme learning machine.A variable learning coefcient is employed to prevent too large a learning increment.A numerical experiment demonstrates that a network pruned by L1/2regularization has fewer hidden nodes but provides better performance than both the original network and the network pruned by L2regularization.
引用
收藏
页码:119 / 125
页数:7
相关论文
共 50 条
  • [41] The Extreme Learning Machine Algorithm for Classifying Fingerprints
    Zabala-Blanco, David
    Mora, Marco
    Hernandez-Garcia, Ruber
    Barrientos, Ricardo J.
    [J]. 2020 39TH INTERNATIONAL CONFERENCE OF THE CHILEAN COMPUTER SCIENCE SOCIETY (SCCC), 2020,
  • [42] Extreme learning machine: algorithm, theory and applications
    Shifei Ding
    Han Zhao
    Yanan Zhang
    Xinzheng Xu
    Ru Nie
    [J]. Artificial Intelligence Review, 2015, 44 : 103 - 115
  • [43] Quantum algorithm for twin extreme learning machine
    Ning, Tong
    Yang, Youlong
    Du, Zhenye
    [J]. PHYSICA SCRIPTA, 2023, 98 (08)
  • [44] L1-PLS Based on Incremental Extreme Learning Machine
    Sun, Zhiying
    Zhou, Jinglin
    [J]. PROCEEDINGS OF 2020 IEEE 9TH DATA DRIVEN CONTROL AND LEARNING SYSTEMS CONFERENCE (DDCLS'20), 2020, : 947 - 952
  • [45] Is L2 learning the same as L1 learning? Learning L2 phonology in optimality theory
    Swanson, KAB
    [J]. PAST, PRESENT, AND FUTURE OF SECOND LANGUAGE RESEARCH, PROCEEDINGS, 2001, : 23 - 41
  • [46] Neuron Pruning-Based Discriminative Extreme Learning Machine for Pattern Classification
    Guo, Tan
    Zhang, Lei
    Tan, Xiaoheng
    [J]. COGNITIVE COMPUTATION, 2017, 9 (04) : 581 - 595
  • [47] THE L1 IN L2 LEARNING: TEACHERS' BELIEFS AND PRACTICES
    Chen, Xiaoqing
    [J]. STUDIES IN SECOND LANGUAGE ACQUISITION, 2010, 32 (03) : 515 - 515
  • [48] Neuron Pruning-Based Discriminative Extreme Learning Machine for Pattern Classification
    Tan Guo
    Lei Zhang
    Xiaoheng Tan
    [J]. Cognitive Computation, 2017, 9 : 581 - 595
  • [49] THE ERRORS OF ITALIAN L1 AND L2: INTERFERENCE AND LEARNING
    Solarino, Rosaria
    [J]. ITALIANO LINGUADUE, 2010, 2 (02) : 15 - 22
  • [50] The extreme learning machine learning algorithm with tunable activation function
    Li, Bin
    Li, Yibin
    Rong, Xuewen
    [J]. NEURAL COMPUTING & APPLICATIONS, 2013, 22 (3-4): : 531 - 539