A pruning algorithm with L1/2 regularizer for extreme learning machine

被引:0
|
作者
Ye-tian FAN [1 ]
Wei WU [1 ]
Wen-yu YANG [2 ]
Qin-wei FAN [1 ]
Jian WANG [1 ]
机构
[1] School of Mathematical Sciences,Dalian University of Technology
[2] College of Science,Huazhong Agricultural University
基金
中央高校基本科研业务费专项资金资助; 中国国家自然科学基金;
关键词
Extreme learning machine(ELM); L1/2; regularizer; Network pruning;
D O I
暂无
中图分类号
TP181 [自动推理、机器学习];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Compared with traditional learning methods such as the back propagation(BP)method,extreme learning machine provides much faster learning speed and needs less human intervention,and thus has been widely used.In this paper we combine the L1/2regularization method with extreme learning machine to prune extreme learning machine.A variable learning coefcient is employed to prevent too large a learning increment.A numerical experiment demonstrates that a network pruned by L1/2regularization has fewer hidden nodes but provides better performance than both the original network and the network pruned by L2regularization.
引用
收藏
页码:119 / 125
页数:7
相关论文
共 50 条
  • [1] A pruning algorithm with L1/2 regularizer for extreme learning machine
    Ye-tian Fan
    Wei Wu
    Wen-yu Yang
    Qin-wei Fan
    Jian Wang
    [J]. Journal of Zhejiang University SCIENCE C, 2014, 15 : 119 - 125
  • [2] A pruning algorithm with L 1/2 regularizer for extreme learning machine
    Fan, Ye-tian
    Wu, Wei
    Yang, Wen-yu
    Fan, Qin-wei
    Wang, Jian
    [J]. JOURNAL OF ZHEJIANG UNIVERSITY-SCIENCE C-COMPUTERS & ELECTRONICS, 2014, 15 (02): : 119 - 125
  • [3] A pruning ensemble model of extreme learning machine with L1/2 regularizer
    He, Bo
    Sun, Tingting
    Yan, Tianhong
    Shen, Yue
    Nian, Rui
    [J]. MULTIDIMENSIONAL SYSTEMS AND SIGNAL PROCESSING, 2017, 28 (03) : 1051 - 1069
  • [4] Double parallel feedforward neural network based on extreme learning machine with L1/2 regularizer
    Khan, Atlas
    Yang, Jie
    Wu, Wei
    [J]. NEUROCOMPUTING, 2014, 128 : 113 - 118
  • [5] Regression and Multiclass Classification Using Sparse Extreme Learning Machine via Smoothing Group L1/2 Regularizer
    Fan, Qinwei
    Niu, Lei
    Kang, Qian
    [J]. IEEE ACCESS, 2020, 8 : 191482 - 191494
  • [6] A Pruning Algorithm for Extreme Learning Machine
    Li Ying
    Li Fan-jun
    [J]. INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2013, 2013, 8206 : 1 - 7
  • [7] A New Pruning Algorithm for Extreme Learning Machine
    Tian, Yuan
    Yu, Yuanlong
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION (IEEE ICIA 2017), 2017, : 704 - 709
  • [8] A Generalized Pruning Algorithm for Extreme Learning Machine
    Sun, Kai
    Yu, Yuanlong
    Huang, Zhiyong
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION, 2015, : 1431 - 1436
  • [9] Neural Network Optimization Algorithm Model Combining L1/2 Regularization and Extreme Learning Machine
    Qi, Anzhi
    [J]. PROCEEDINGS OF THE 2018 3RD INTERNATIONAL WORKSHOP ON MATERIALS ENGINEERING AND COMPUTER SCIENCES (IWMECS 2018), 2018, 78 : 106 - 109
  • [10] Dictionary Learning with l1/2 regularizer for Sparsity Based on Proximal Operator
    Li, Zhenni
    Ding, Shuxue
    Li, Yujie
    Chen, Wuhui
    [J]. 2015 IEEE 7TH INTERNATIONAL CONFERENCE ON AWARENESS SCIENCE & TECHNOLOGY (ICAST), 2015, : 105 - 110