Active learning sample selection - based on multicriteria

被引:0
|
作者
He, Zhonghai [1 ,2 ]
Shen, Kun [1 ,4 ]
Zhang, Xiaofang [3 ]
机构
[1] Northeastern Univ Qinhuangdao, Sch Control Engn, Qinhuangdao, Peoples R China
[2] Hebei Key Lab Micronano Precis Opt Sensing & Meas, Qinhuangdao, Peoples R China
[3] Beijing Inst Technol, Sch Opt & Photon, Beijing, Peoples R China
[4] Northeastern Univ Qinhuangdao, Sch Control Engn, Qinhuangdao 066000, Peoples R China
关键词
Multivariate calibration; multicriteria modeling; active learning; sample selection; CALIBRATION; REGRESSION; DENSITY; QUERY; SETS;
D O I
10.1177/09670335231211618
中图分类号
O69 [应用化学];
学科分类号
081704 ;
摘要
In multivariate calibration problems, model performance is affected significantly by the calibration samples used during model building. In recent years, active learning methods have become one of the best methods for sample selection. However, most active learning methods only select instances from prediction uncertainty or sample space distance, and these single-criteria methods tend to select undesired samples. In addition, sample density characterizes the spatial information carried by the sample, but few studies in quantitative analysis utilize sample density alone to select calibration samples. Considering these issues, based on the k-means clustering algorithm, this paper proposes an active learning sample selection method (DIDAL), which combines the three criteria of diversity, informativeness and sample density. The most representative sample is iteratively selected for - addition to the calibration set for modeling and estimating the chemical concentration of analytes. Soybean meal and soy sauce samples were analyzed by DIDAL and compared with existing sample selection methods. The prediction results show that the DIDAL algorithm significantly outperforms several existing algorithms and is close to the performance of full-sample modeling. A model with high prediction accuracy can be constructed by selecting only a few samples using the DIDAL method.
引用
收藏
页码:289 / 297
页数:9
相关论文
共 50 条
  • [31] Neighborhood based sample and feature selection for SVM classification learning
    He, Qiang
    Xie, Zongxia
    Hu, Qinghua
    Wu, Congxin
    NEUROCOMPUTING, 2011, 74 (10) : 1585 - 1594
  • [32] Ensemble-based active learning for parse selection
    Osborne, M
    Baldridge, J
    HLT-NAACL 2004: HUMAN LANGUAGE TECHNOLOGY CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE MAIN CONFERENCE, 2004, : 89 - 96
  • [33] An improved active learning method based on feature selection
    Fu, Chunjiang
    Gong, Liang
    Yang, Yupu
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON APPLIED SCIENCE AND ENGINEERING INNOVATION, 2015, 12 : 170 - 174
  • [34] A multi-stage active learning framework with an instance-based sample selection algorithm for steel surface defect
    Gao, Shuo
    Jiang, Yimin
    Xia, Tangbin
    Li, Yaping
    Zhu, Ying
    Xi, Lifeng
    ADVANCED ENGINEERING INFORMATICS, 2025, 64
  • [35] ACTIVE LEARNING TO OVERCOME SAMPLE SELECTION BIAS: APPLICATION TO PHOTOMETRIC VARIABLE STAR CLASSIFICATION
    Richards, Joseph W.
    Starr, Dan L.
    Brink, Henrik
    Miller, Adam A.
    Bloom, Joshua S.
    Butler, Nathaniel R.
    James, J. Berian
    Long, James P.
    Rice, John
    ASTROPHYSICAL JOURNAL, 2012, 744 (02):
  • [36] Sample Selection Method in Supervised Learning Based on Adaptive Estimated Threshold
    Zhang, Zeya
    Zhou, Zhiheng
    Shen, Dongkai
    PROCEEDINGS OF 2013 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), VOLS 1-4, 2013, : 1861 - 1864
  • [37] A SVC iterative learning algorithm based on sample selection for large samples
    Chen, Zi-Jie
    Liu, Bo
    He, Xu-Peng
    PROCEEDINGS OF 2007 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2007, : 3308 - +
  • [38] Active Sample Selection Based Incremental Algorithm for Attribute Reduction With Rough Sets
    Yang, Yanyan
    Chen, Degang
    Wang, Hui
    IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2017, 25 (04) : 825 - 838
  • [39] A Quality-based Active Sample Selection Strategy for Statistical Machine Translation
    Logacheva, Varvara
    Specia, Lucia
    LREC 2014 - NINTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, 2014, : 2690 - 2695
  • [40] Feature selection active learning algorithm based on sparse subspace
    Gong, Liang
    Wang, Xu-Hong
    Yang, Yu-Pu
    Journal of Computers (Taiwan), 2021, 32 (02) : 23 - 32