Incremental Multilayer Broad Learning System With Stochastic Configuration Algorithm for Regression

被引:4
|
作者
Ding, Shifei [1 ,2 ]
Zhang, Chenglong [1 ,2 ]
Zhang, Jian [1 ,2 ]
Guo, Lili [1 ,2 ]
Ding, Ling [3 ]
机构
[1] China Univ Min & Technol, Sch Comp Sci & Technol, Xuzhou 221116, Peoples R China
[2] Minist Educ, Mine Digitizat Engn Res Ctr, Xuzhou 221116, Peoples R China
[3] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China
基金
中国国家自然科学基金;
关键词
Broad learning system (BLS); hierarchical; incremental learning; regression; stochastic configuration network (SCN); NEURAL-NETWORKS; APPROXIMATION;
D O I
10.1109/TCDS.2022.3192536
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Broad learning system (BLS) is a novel randomized learning framework which has a faster modeling efficiency. Although BLS with incremental learning has a better extendibility for updating model rapidly, the incremental mode of BLS lacks a self-supervision mechanism which cannot adjust the structure adaptively. Learning from the idea of stochastic configuration network (SCN), a novel incremental multilayer BLS based on the stochastic configuration (SC) algorithm is proposed for regression, termed as IMLBLS-SC. First, to improve the feature learning ability, the SC algorithm is adopted to configure the parameters of enhancement nodes instead of random weights. Second, the multilayer model with enhancement nodes can be added gradually according to the supervision mechanism without human intervention. Third, all the enhancement nodes and feature nodes are fully connected with output nodes. Finally, two function approximation problems and eight classical data sets are selected to verify the regression performance of IMLBLS-SC, experimental results demonstrate that IMLBLS-SC outperforms the random vector functional-link neural network, SCN, BLS, and broad SCN.
引用
收藏
页码:877 / 886
页数:10
相关论文
共 50 条
  • [41] An active learning-based incremental deep-broad learning algorithm for unbalanced time series prediction
    Shen, Xin
    Dai, Qun
    Ullah, Wusat
    [J]. INFORMATION SCIENCES, 2023, 642
  • [42] Incremental learning algorithm for large-scale semi-supervised ordinal regression
    Chen, Haiyan
    Jia, Yizhen
    Ge, Jiaming
    Gu, Bin
    [J]. NEURAL NETWORKS, 2022, 149 : 124 - 136
  • [43] Improved Regression Models for Algorithm Configuration
    de Souza, Marcelo
    Ritt, Marcus
    [J]. PROCEEDINGS OF THE 2022 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE (GECCO'22), 2022, : 222 - 231
  • [44] Using Stochastic Gradient Decent Algorithm For Incremental Matrix Factorization In Recommendation System
    Nguyen, Si-Thin
    Kwak, Hyun-Young
    Lee, Seok-Hee
    Gim, Gwang-Yong
    [J]. 2019 20TH IEEE/ACIS INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, ARTIFICIAL INTELLIGENCE, NETWORKING AND PARALLEL/DISTRIBUTED COMPUTING (SNPD), 2019, : 308 - 319
  • [45] A finite time discrete distributed learning algorithm using stochastic configuration network
    Xie, Jin
    Liu, Sanyang
    Chen, Jiaxi
    Gao, Weifeng
    Li, Hong
    Xiong, Ranran
    [J]. INFORMATION SCIENCES, 2022, 613 : 33 - 49
  • [46] An adaptive incremental TSK fuzzy system based on stochastic configuration and its approximation capability analysis
    Zhou, Wei
    Wang, Degang
    Li, Hongxing
    Bao, Menghong
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 44 (06) : 10131 - 10143
  • [47] An algorithm for incremental inductive learning
    Pham, DT
    Dimov, SS
    [J]. PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART B-JOURNAL OF ENGINEERING MANUFACTURE, 1997, 211 (03) : 239 - 249
  • [48] Functional incremental least square regression algorithm
    Shen, Yujing
    Zou, Kunjin
    Zou, Bin
    Xu, Jie
    Zeng, Jingjing
    [J]. INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2024,
  • [49] Incremental algorithm of multiple linear regression model
    [J]. Huang, Lele, 1600, Beijing University of Aeronautics and Astronautics (BUAA) (40):
  • [50] A latent representation dual manifold regularization broad learning system with incremental learning capability for fault diagnosis
    Mou, Miao
    Zhao, Xiaoqiang
    Liu, Kai
    Cao, Shiyu
    Hui, Yongyong
    [J]. MEASUREMENT SCIENCE AND TECHNOLOGY, 2023, 34 (07)