A Survey of Distributed and Parallel Extreme Learning Machine for Big Data

被引:5
|
作者
Wang, Zhiqiong [1 ,4 ,5 ]
Sui, Ling [2 ]
Xin, Junchang [2 ]
Qu, Luxuan [1 ]
Yao, Yudong [3 ]
机构
[1] Northeastern Univ, Coll Med & Biol Informat Engn, Shenyang 110819, Peoples R China
[2] Northeastern Univ, Sch Comp Sci & Engn, Key Lab Big Data Management & Analyt Liaoning, Shenyang 110819, Peoples R China
[3] Stevens Inst Technol, Dept Eletr & Comp Engn, Hoboken, NJ 07030 USA
[4] Neusoft Res Intelligent Healthcare Technol Co Ltd, Shenyang 110179, Peoples R China
[5] Harbin Engn Univ, Acousit Sci & Technol Lab, Harbin 0086, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Extreme learning machine; distributed processing; ensemble; matrix operation; ELM; CLASSIFICATION; REGRESSION; FRAMEWORK; MAPREDUCE; ALGORITHM; TRENDS; ROBUST;
D O I
10.1109/ACCESS.2020.3035398
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Extreme learning machine (ELM) is characterized by good generalization performance, fast training speed and less human intervention. With the explosion of large amount of data generated on the Internet, the learning algorithm in the single-machine environment cannot meet the huge memory consumption of matrix computing, so the implement of distributed ELM algorithm has gradually become one of the research focuses. In view of the research significance and implementation value of distributed ELM, this paper first introduced the research background of ELM and improved ELM. Secondly, this paper elaborated the implementation method of distributed ELM from the two directions: ensemble and matrix operation. Finally, we summarized the development status of distributed ELM and discussed the future research direction.
引用
收藏
页码:201247 / 201258
页数:12
相关论文
共 50 条
  • [1] Distributed Weighted Extreme Learning Machine for Big Imbalanced Data Learning
    Wang, Zhiqiong
    Xin, Junchang
    Tian, Shuo
    Yu, Ge
    PROCEEDINGS OF ELM-2015, VOL 1: THEORY, ALGORITHMS AND APPLICATIONS (I), 2016, 6 : 319 - 332
  • [2] Distributed and Weighted Extreme Learning Machine for Imbalanced Big Data Learning
    Wang, Zhiqiong
    Xin, Junchang
    Yang, Hongxu
    Tian, Shuo
    Yu, Ge
    Xu, Chenren
    Yao, Yudong
    TSINGHUA SCIENCE AND TECHNOLOGY, 2017, 22 (02) : 160 - 173
  • [3] Distributed and Weighted Extreme Learning Machine for Imbalanced Big Data Learning
    Zhiqiong Wang
    Junchang Xin
    Hongxu Yang
    Shuo Tian
    Ge Yu
    Chenren Xu
    Yudong Yao
    Tsinghua Science and Technology, 2017, 22 (02) : 160 - 173
  • [4] Distributed parallel deep learning of Hierarchical Extreme Learning Machine for multimode quality prediction with big process data
    Yao, Le
    Ge, Zhiqiang
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2019, 81 : 450 - 465
  • [5] A Parallel Multiclassification Algorithm for Big Data Using an Extreme Learning Machine
    Duan, Mingxing
    Li, Kenli
    Liao, Xiangke
    Li, Keqin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (06) : 2337 - 2351
  • [6] Parallel and Distributed Machine Learning Algorithms for Scalable Big Data Analytics
    Bal, Henri
    Pal, Arindam
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 108 : 1159 - 1161
  • [7] Dynamic Distributed and Parallel Machine Learning algorithms for big data mining processing
    Djafri, Laouni
    DATA TECHNOLOGIES AND APPLICATIONS, 2022, 56 (04) : 558 - 601
  • [8] GPU-Accelerated Parallel Hierarchical Extreme Learning Machine on Flink for Big Data
    Chen, Cen
    Li, Kenli
    Ouyang, Aijia
    Tang, Zhuo
    Li, Keqin
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2017, 47 (10): : 2740 - 2753
  • [9] Elastic extreme learning machine for big data classification
    Xin, Junchang
    Wang, Zhiqiong
    Qu, Luxuan
    Wang, Guoren
    NEUROCOMPUTING, 2015, 149 : 464 - 471
  • [10] An Integration of Extreme Learning Machine for Classification of Big Data
    Zhou, Guanwu
    Zhao, Yulong
    Xu, Wenju
    PROCEEDINGS OF 2013 INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND COMPUTER APPLICATIONS (ICSA 2013), 2013, 92 : 81 - 86