A fast conformal predictive system with regularized extreme learning machine

被引:12
|
作者
Wang, Di [1 ]
Wang, Ping [1 ]
Yuan, Yue [1 ]
Wang, Pingping [1 ]
Shi, Junzhi [1 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
关键词
Conformal predictive system; Cross-conformal predictive system; Cumulative distribution function; Asymptotic validity; Regularized extreme learning machine; REGRESSION; KERNEL;
D O I
10.1016/j.neunet.2020.03.022
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A conformal predictive system(CPS) is based on the learning framework of conformal prediction, which outputs cumulative distribution functions(CDFs) for labels in regression problems. The CDFs output by a CPS provide useful information for users, as they not only provide probability for the events related to the test labels, but also can be transformed to prediction intervals with the corresponding quantiles. Moreover, CPSs have the property of validity since the distributions and intervals they output have statistical compatibility with the realizations. This property is very useful for many risk-sensitive applications such as financial time series forecast and weather forecast. However, as based on conformal predictors, CPSs inherit the computational issue. To build a fast CPS, in this paper, we propose a CPS with regularized extreme learning machine as the underlying algorithm. To be specific, we combine the leave-one-out cross-conformal predictive system(Leave-One-Out CCPS), a variant of the original CPS, with regularized extreme learning machine(RELM), which is named as LOO-CCPS-RELM. We analyse the computational complexity of it and prove its asymptotic validity based on some regularity assumptions. We also prove that the error rate of the prediction interval output by LOO-CCPS-RELM is under control in the asymptotic setting. Experiments with 20 public data sets were conducted to test LOO-CCPS-RELM and the results showed that LOO-CCPS-RELM is empirically valid and compared favourably with the other CPSs. (c) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页码:347 / 361
页数:15
相关论文
共 50 条
  • [1] A fast and efficient conformal regressor with regularized extreme learning machine
    Wang, Di
    Wang, Ping
    Shi, Junzhi
    [J]. NEUROCOMPUTING, 2018, 304 : 1 - 11
  • [2] Fast cross validation for regularized extreme learning machine
    Zhao, Yongping
    Wang, Kangkang
    [J]. JOURNAL OF SYSTEMS ENGINEERING AND ELECTRONICS, 2014, 25 (05) : 895 - 900
  • [3] Fast cross validation for regularized extreme learning machine
    Yongping Zhao
    Kangkang Wang
    [J]. Journal of Systems Engineering and Electronics, 2014, 25 (05) : 895 - 900
  • [4] Regularized Extreme Learning Machine
    Deng, Wanyu
    Zheng, Qinghua
    Chen, Lin
    [J]. 2009 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DATA MINING, 2009, : 389 - 395
  • [5] Manifold regularized extreme learning machine
    Liu, Bing
    Xia, Shi-Xiong
    Meng, Fan-Rong
    Zhou, Yong
    [J]. NEURAL COMPUTING & APPLICATIONS, 2016, 27 (02): : 255 - 269
  • [6] Smoothing Regularized Extreme Learning Machine
    Fan, Qin-Wei
    He, Xing-Shi
    Yang, Xin-She
    [J]. ENGINEERING APPLICATIONS OF NEURAL NETWORKS, EANN 2018, 2018, 893 : 83 - 93
  • [7] Manifold regularized extreme learning machine
    Bing Liu
    Shi-Xiong Xia
    Fan-Rong Meng
    Yong Zhou
    [J]. Neural Computing and Applications, 2016, 27 : 255 - 269
  • [8] A fast conformal classifier based on multi-output extreme learning machine
    Wang, Di
    Wang, Ping
    Shi, Jun-Zhi
    [J]. Kongzhi yu Juece/Control and Decision, 2019, 34 (03): : 555 - 560
  • [9] An Adaptive Learning Algorithm for Regularized Extreme Learning Machine
    Zhang, Yuao
    Wu, Qingbiao
    Hu, Jueliang
    [J]. IEEE ACCESS, 2021, 9 : 20736 - 20745
  • [10] Timeliness Online Regularized Extreme Learning Machine
    Luo, Xiong
    Yang, Xiaona
    Jiang, Changwei
    Ban, Xiaojuan
    [J]. PROCEEDINGS OF ELM-2015, VOL 1: THEORY, ALGORITHMS AND APPLICATIONS (I), 2016, 6 : 477 - 487