Active learning using localized generalization error of candidate sample as criterion

被引:0
|
作者
Chan, PPK [1 ]
Ng, WWY [1 ]
Yeung, DS [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Hong Kong, Peoples R China
关键词
active learning; localized generalization error; RBF neural network; stochastic sensitivity analysis;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In classification problem, the learning process can be more efficient if the informative samples can be selected actively based on the knowledge of the classifier. This problem is called active learning. Most of the existing active learning methods did not directly relate to the generalization error of classifiers. Also, some of them need high computational time or are based on strict assumptions. This paper describes a new active learning strategy using the concept of localized generalization error of the candidate samples. The sample which yields the largest generalization error will be chosen for query. This method can be applied to different kinds of classifiers and its complexity is low. Experimental results demonstrate that the prediction accuracy of the classifier can be improved by using this selecting method and fewer training samples are possible for the same prediction accuracy.
引用
收藏
页码:3604 / 3609
页数:6
相关论文
共 50 条
  • [21] Active learning in approximately linear regression based on conditional expectation of generalization error
    Sugiyama, M
    JOURNAL OF MACHINE LEARNING RESEARCH, 2006, 7 : 141 - 166
  • [22] Localized generalization error and its application to RBFNN training
    Ng, WWY
    Yeung, DS
    Wang, DF
    Tsang, ECC
    Wang, XZ
    PROCEEDINGS OF 2005 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-9, 2005, : 4667 - 4673
  • [23] Generalization and learning error for nonlinear perceptron
    Shcherbina, M
    Tirozzi, B
    MATHEMATICAL AND COMPUTER MODELLING, 2002, 35 (3-4) : 259 - 271
  • [24] A generalization error for Q-learning
    Murphy, Susan A.
    Journal of Machine Learning Research, 2005, 6
  • [25] Tradeoff of generalization error in unsupervised learning
    Kim, Gilhan
    Lee, Hojun
    Jo, Junghyo
    Baek, Yongjoo
    JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT, 2023, 2023 (08):
  • [26] A generalization error for Q-learning
    Murphy, SA
    JOURNAL OF MACHINE LEARNING RESEARCH, 2005, 6 : 1073 - 1097
  • [27] A GENERALIZATION OF NYQUISTS CRITERION TO THE STABILITY OF ACTIVE LINEAR SYSTEMS
    BERMAN, G
    JOURNAL OF THE SOCIETY FOR INDUSTRIAL AND APPLIED MATHEMATICS, 1961, 9 (03): : 440 - 454
  • [28] IMPROVING GENERALIZATION WITH ACTIVE LEARNING
    COHN, D
    ATLAS, L
    LADNER, R
    MACHINE LEARNING, 1994, 15 (02) : 201 - 221
  • [29] Applying a new localized generalization error model to design neural networks trained with extreme learning machine
    Qiang Liu
    Jianping Yin
    Victor C. M. Leung
    Jun-Hai Zhai
    Zhiping Cai
    Jiarun Lin
    Neural Computing and Applications, 2016, 27 : 59 - 66
  • [30] Applying a new localized generalization error model to design neural networks trained with extreme learning machine
    Liu, Qiang
    Yin, Jianping
    Leung, Victor C. M.
    Zhai, Jun-Hai
    Cai, Zhiping
    Lin, Jiarun
    NEURAL COMPUTING & APPLICATIONS, 2016, 27 (01): : 59 - 66