Support subsets estimation for support vector machines retraining

被引:1
|
作者
Acena, Victor [1 ,2 ]
Martin de Diego, Isaac [1 ]
Fernandez, Ruben R. [1 ]
Moguerza, Javier M. [1 ]
机构
[1] Rey Juan Carlos Univ, Data Sci Lab, C Tulipan S-N, Mostoles 28933, Spain
[2] MADOX VIAJES, Calle Cantabria 10, Arroyomolinos 28939, Spain
关键词
Support subset; SVM; Incremental learning; Retraining; Alpha seeding;
D O I
10.1016/j.patcog.2022.109117
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The availability of new data in previously trained Machine Learning ( ML ) models usually requires re-training and adjustment of the model. Support Vector Machines (SVMs) are widely used in ML because of their strong mathematical foundations and flexibility. However, SVM training is computationally ex-pensive, both in time and memory. Hence, the training phase might be a limitation in problems where the model is updated regularly. As a solution, new methods for training and updating SVMs have been proposed in the past. In this paper, we introduce the concept of Support Subset and a new retraining methodology for SVMs. A Support Subset is a subset of the training set, such that retraining a ML model with this subset and the new data is equivalent to training with all the data. The performance of the proposal is evaluated in a variety of experiments on simulated and real datasets in terms of time, quality of the solution, resultant support vectors, and amount of employed data. The promising results provide a new research line for improving the effectiveness and adaptability of the proposed technique, including its generalization to other ML models.(c) 2022 Published by Elsevier Ltd.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Multiclass Probability Estimation With Support Vector Machines
    Wang, Xin
    Zhang, Hao Helen
    Wu, Yichao
    [J]. JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2019, 28 (03) : 586 - 595
  • [2] Support vector machines for the estimation of aqueous solubility
    Lind, P
    Maltseva, T
    [J]. JOURNAL OF CHEMICAL INFORMATION AND COMPUTER SCIENCES, 2003, 43 (06): : 1855 - 1859
  • [3] Estimation of sand liquefaction based on support vector machines
    Su Yong-hua
    Ma Ning
    Hu Jian
    Yang Xiao-li
    [J]. JOURNAL OF CENTRAL SOUTH UNIVERSITY OF TECHNOLOGY, 2008, 15 (Suppl 2): : 15 - 20
  • [4] Support vector machines for robust channel estimation in OFDM
    Fernandez-Getino Garcia, M. Julia
    Luis Rojo-Alvarez, Jose
    Alonso-Atienza, Felipe
    Martinez-Ramon, Manel
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2006, 13 (07) : 397 - 400
  • [5] Estimation of sand liquefaction based on support vector machines
    苏永华
    马宁
    胡检
    杨小礼
    [J]. Journal of Central South University, 2008, 15 (S2) : 15 - 20
  • [6] Estimation of sand liquefaction based on support vector machines
    Yong-hua Su
    Ning Ma
    Jian Hu
    Xiao-li Yang
    [J]. Journal of Central South University of Technology, 2008, 15 : 15 - 20
  • [7] Distributed Estimation of Support Vector Machines for Matrix Data
    Xu, Wangli
    Liu, Jiamin
    Lian, Heng
    [J]. IEEE Transactions on Neural Networks and Learning Systems, 2024, 35 (05) : 6643 - 6653
  • [8] Using robust dispersion estimation in support vector machines
    Vretos, N.
    Tefas, A.
    Pitas, I.
    [J]. PATTERN RECOGNITION, 2013, 46 (12) : 3441 - 3451
  • [9] Wafer yield estimation using support vector machines
    Chen, Lei-Ting
    Lin, David
    Muuniz, Dan
    Wang, Chia-Jiu
    [J]. ADVANCES IN NEURAL NETWORKS - ISNN 2006, PT 3, PROCEEDINGS, 2006, 3973 : 1053 - 1058
  • [10] Support vector machines
    Guenther, Nick
    Schonlau, Matthias
    [J]. STATA JOURNAL, 2016, 16 (04): : 917 - 937