A fast conformal classifier based on multi-output extreme learning machine

被引:0
|
作者
Wang D. [1 ]
Wang P. [1 ]
Shi J.-Z. [1 ]
机构
[1] School of Electrical and Information Engineering, Tianjin University, Tianjin
来源
Kongzhi yu Juece/Control and Decision | 2019年 / 34卷 / 03期
关键词
Conformal classifier; Conformal prediction; Fast learning; Jackknife conformal prediction; Multi-output extreme learning machine; Neural network;
D O I
10.13195/j.kzyjc.2017.1172
中图分类号
学科分类号
摘要
A conformal classifier is a conformal prediction based classifier. Although the prediction is highly valid, the learning time of conformal classifiers is often very long due to the limitation of the computational framework. To make the conformal classifier learn faster, this paper firstly proposes an algorithm combining the conformal prediction with the multi-output extreme learning machine whose leave-one-out predictions on the training set can be computed efficiently. From the analysis of algorithm complexity, the computational complexity of the proposed algorithm is equivalent to that of the multi-output extreme learning machine. The experiments on ten public data sets show that the proposed our algorithm has fast computation speed and inherits the property of validity from conformal prediction, whose prediction error can be controlled by the significance level. The average number of labels per prediction of the proposed algorithm is lower than that of other common conformal classifiers on some data sets, which shows that of is more efficient in some applications. © 2019, Editorial Office of Control and Decision. All right reserved.
引用
收藏
页码:555 / 560
页数:5
相关论文
共 18 条
  • [1] Vovk V., Gammerman A., Shafer G., Algorithmic Learning in a Random World, pp. 1-16, (2005)
  • [2] Balasubramanian V., Ho S.S., Vovk V., Conformal Prediction for Reliable Machine Learning: Theory, Adaptations and Applications, pp. 1-46, (2014)
  • [3] Vovk V., Cross-conformal predictors, Annals of Mathematics and Artificial Intelligence, 74, 1-2, pp. 9-28, (2015)
  • [4] Lei J., G'Sell M., Rinaldo A., Et al., Distribution-free predictive inference for regression, J of the American Statistical Association, (2017)
  • [5] Huang G.B., Zhou H., Ding X., Et al., Extreme learning machine for regression and multiclass classification, IEEE Trans on Systems, Man, and Cybernetics, Part B (Cybernetics), 42, 2, pp. 513-529, (2012)
  • [6] Huang G.B., What are extreme learning machines? filling the gap between frank rosenblatts dream and john von neumanns puzzle, Cognitive Computation, 7, 3, pp. 263-278, (2015)
  • [7] Huang G.B., Zhu Q.Y., Siew C.K., Extreme learning machine: Theory and applications, Neurocomputing, 70, 1, pp. 489-501, (2006)
  • [8] Chorowski J., Wang J., Zurada J.M., Review and performance comparison of SVM-and ELM-based classifiers, Neurocomputing, 128, 5, pp. 507-516, (2014)
  • [9] Huang G., Huang G.B., Song S., Et al., Trends in extreme learning machines, Neural Networks, 61, C, pp. 32-48, (2015)
  • [10] Xu J.M., Zhang W.Q., Yang D.Z., Et al., Manifold regularized extreme learning machine for language recognition, Acta Automatica Sinica, 41, 9, pp. 1680-1685, (2015)