Scaling Up Support Vector Machines Using Nearest Neighbor Condensation

被引:33
|
作者
Angiulli, Fabrizio [1 ]
Astorino, Annabella [2 ]
机构
[1] Univ Calabria, Dept Elect Comp Sci & Syst Engn, I-87036 Arcavacata Di Rende, CS, Italy
[2] CNR, Inst High Performance Networking & Comp, I-87036 Arcavacata Di Rende, CS, Italy
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2010年 / 21卷 / 02期
关键词
Support vector machines; Training; Accuracy; Kernel; Nearest neighbor searches; Data mining; Clustering algorithms; support vector machines (SVMs); Classification; large data sets; training-set condensation; nearest neighbor rule;
D O I
10.1109/TNN.2009.2039227
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this brief, we describe the FCNN-SVM classifier, which combines the support vector machine (SVM) approach and the fast nearest neighbor condensation classification rule (FCNN) in order to make SVMs practical on large collections of data. As a main contribution, it is experimentally shown that, on very large and multidimensional data sets, the FCNN-SVM is one or two orders of magnitude faster than SVM, and that the number of support vectors (SVs) is more than halved with respect to SVM. Thus, a drastic reduction of both training and testing time is achieved by using the FCNN-SVM. This result is obtained at the expense of a little loss of accuracy. The FCNN-SVM is proposed as a viable alternative to the standard SVM in applications where a fast response time is a fundamental requirement. © 2009 IEEE.
引用
收藏
页码:351 / 357
页数:7
相关论文
共 50 条
  • [1] Adaptive nearest neighbor classification using support vector machines
    Domeniconi, C
    Gunopulos, D
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 14, VOLS 1 AND 2, 2002, 14 : 665 - 672
  • [2] Nearest Neighbor Classifiers versus Random Forests and Support Vector Machines
    Sathe, Saket
    Aggarwal, Charu C.
    2019 19TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2019), 2019, : 1300 - 1305
  • [3] Scaling-up support vector machines using boosting algorithm
    Pavlov, D
    Mao, JC
    Dom, B
    15TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 2, PROCEEDINGS: PATTERN RECOGNITION AND NEURAL NETWORKS, 2000, : 219 - 222
  • [4] A comparative analysis of structural risk minimization by support vector machines and nearest neighbor rule
    Karaçali, B
    Ramanath, R
    Snyder, WE
    PATTERN RECOGNITION LETTERS, 2004, 25 (01) : 63 - 71
  • [5] Support Vector Machines based on K Nearest Neighbor Algorithm for Outlier Detection in WSNs
    Xu, Suya
    Hu, Caiping
    Wang, Lisong
    Zhang, Guobin
    2012 INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS, NETWORKING AND MOBILE COMPUTING (WICOM), 2012,
  • [6] Prediction of human breast and colon cancers from imbalanced data using nearest neighbor and support vector machines
    Majid, Abdul
    Ali, Safdar
    Iqbal, Mubashar
    Kausar, Nabeela
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2014, 113 (03) : 792 - 808
  • [7] Nearest neighbors methods for support vector machines
    S. A. Camelo
    M. D. González-Lima
    A. J. Quiroz
    Annals of Operations Research, 2015, 235 : 85 - 101
  • [8] Nearest neighbors methods for support vector machines
    Camelo, S. A.
    Gonzalez-Lima, M. D.
    Quiroz, A. J.
    ANNALS OF OPERATIONS RESEARCH, 2015, 235 (01) : 85 - 101
  • [9] Using Support Vector Machines for Facet Partitioning in Multidimensional Scaling
    Mair, Patrick
    Cetron, Joshua S.
    Borg, Ingwer
    MULTIVARIATE BEHAVIORAL RESEARCH, 2022, 58 (03) : 526 - 542
  • [10] Scaling up sparse support vector machines by simultaneous feature and sample reduction
    Hong, Bin
    Zhang, Weizhong
    Liu, Wei
    Ye, Jieping
    Cai, Deng
    He, Xiaofei
    Wang, Jie
    Journal of Machine Learning Research, 2019, 20