Active learning using localized generalization error of candidate sample as criterion

被引:0
|
作者
Chan, PPK [1 ]
Ng, WWY [1 ]
Yeung, DS [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Hong Kong, Peoples R China
关键词
active learning; localized generalization error; RBF neural network; stochastic sensitivity analysis;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In classification problem, the learning process can be more efficient if the informative samples can be selected actively based on the knowledge of the classifier. This problem is called active learning. Most of the existing active learning methods did not directly relate to the generalization error of classifiers. Also, some of them need high computational time or are based on strict assumptions. This paper describes a new active learning strategy using the concept of localized generalization error of the candidate samples. The sample which yields the largest generalization error will be chosen for query. This method can be applied to different kinds of classifiers and its complexity is low. Experimental results demonstrate that the prediction accuracy of the classifier can be improved by using this selecting method and fewer training samples are possible for the same prediction accuracy.
引用
收藏
页码:3604 / 3609
页数:6
相关论文
共 50 条
  • [41] The Generalization Error of Dictionary Learning with Moreau Envelopes
    Georgogiannis, Alexandros
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [42] Incremental active learning for optimal generalization
    Sugiyama, M
    Ogawa, H
    NEURAL COMPUTATION, 2000, 12 (12) : 2909 - 2940
  • [43] Learning to Sample: an Active Learning Framework
    Shao, Jingyu
    Wang, Qing
    Liu, Fangbing
    2019 19TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2019), 2019, : 538 - 547
  • [44] A Stopping Criterion for Transductive Active Learning
    Kottke, Daniel
    Sandrock, Christoph
    Krempl, Georg
    Sick, Bernhard
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT IV, 2023, 13716 : 468 - 484
  • [45] A variance maximization criterion for active learning
    Yang, Yazhou
    Loog, Marco
    PATTERN RECOGNITION, 2018, 78 : 358 - 370
  • [46] Prediction Stability as a Criterion in Active Learning
    Liu, Junyu
    Li, Xiang
    Zhou, Jiqiang
    Shen, Jianxiong
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2020, PT II, 2020, 12397 : 157 - 167
  • [47] Large scale analysis of generalization error in learning using margin based classification methods
    Huang, Hanwen
    Yang, Qinglong
    JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT, 2020, 2020 (10):
  • [48] STIMULUS GENERALIZATION AS A FUNCTION OF DISCRIMINATION LEARNING WITHOUT ERROR
    LYONS, JE
    PSYCHONOMIC SCIENCE, 1969, 17 (01): : 50 - &
  • [49] Linear Regression With Distributed Learning: A Generalization Error Perspective
    Hellkvist, Martin
    Ozcelikkale, Ayca
    Ahlen, Anders
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2021, 69 : 5479 - 5495
  • [50] Tight Lower Bound of Generalization Error in Ensemble Learning
    Uchida, Masato
    2014 JOINT 7TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS (SCIS) AND 15TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (ISIS), 2014, : 1130 - 1133