Scaling Up Support Vector Machines Using Nearest Neighbor Condensation

被引:33
|
作者
Angiulli, Fabrizio [1 ]
Astorino, Annabella [2 ]
机构
[1] Univ Calabria, Dept Elect Comp Sci & Syst Engn, I-87036 Arcavacata Di Rende, CS, Italy
[2] CNR, Inst High Performance Networking & Comp, I-87036 Arcavacata Di Rende, CS, Italy
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2010年 / 21卷 / 02期
关键词
Support vector machines; Training; Accuracy; Kernel; Nearest neighbor searches; Data mining; Clustering algorithms; support vector machines (SVMs); Classification; large data sets; training-set condensation; nearest neighbor rule;
D O I
10.1109/TNN.2009.2039227
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this brief, we describe the FCNN-SVM classifier, which combines the support vector machine (SVM) approach and the fast nearest neighbor condensation classification rule (FCNN) in order to make SVMs practical on large collections of data. As a main contribution, it is experimentally shown that, on very large and multidimensional data sets, the FCNN-SVM is one or two orders of magnitude faster than SVM, and that the number of support vectors (SVs) is more than halved with respect to SVM. Thus, a drastic reduction of both training and testing time is achieved by using the FCNN-SVM. This result is obtained at the expense of a little loss of accuracy. The FCNN-SVM is proposed as a viable alternative to the standard SVM in applications where a fast response time is a fundamental requirement. © 2009 IEEE.
引用
收藏
页码:351 / 357
页数:7
相关论文
共 50 条
  • [21] Scaling Up Ensemble of Adaptations for Classification by Approximate Nearest Neighbor Retrieval
    Jalali, Vahid
    Leake, David
    CASE-BASED REASONING RESEARCH AND DEVELOPMENT, ICCBR 2017, 2017, 10339 : 154 - 169
  • [22] Image denoising with k-nearest neighbor and support vector regression
    van Ginneken, Brarn
    Mendrik, Adrienne
    18TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 3, PROCEEDINGS, 2006, : 603 - +
  • [23] Support vector regression and extended nearest neighbor for video object retrieval
    Ghuge, C. A.
    Ruikar, Sachin D.
    Prakash, V. Chandra
    EVOLUTIONARY INTELLIGENCE, 2022, 15 (02) : 837 - 850
  • [24] Support vector regression and extended nearest neighbor for video object retrieval
    C. A. Ghuge
    Sachin D. Ruikar
    V. Chandra Prakash
    Evolutionary Intelligence, 2022, 15 : 837 - 850
  • [25] Support vector based prototype selection method for nearest neighbor rules
    Li, YG
    Hu, ZH
    Cai, YZ
    Zhang, WD
    ADVANCES IN NATURAL COMPUTATION, PT 1, PROCEEDINGS, 2005, 3610 : 528 - 535
  • [26] Face Recognition Based on Support Vector Machine and Nearest Neighbor Classifier
    Zhang Yankun & Liu Chongqing Institute of Image Processing and Pattern Recognition
    Journal of Systems Engineering and Electronics, 2003, (03) : 73 - 76
  • [27] Variable scaling and nearest neighbor methods
    Gertheiss, Jan
    Tutz, Gerhard
    JOURNAL OF CHEMOMETRICS, 2009, 23 (3-4) : 149 - 151
  • [28] Quantum image scaling up based on nearest-neighbor interpolation with integer scaling ratio
    Jiang, Nan
    Wang, Jian
    Mu, Yue
    QUANTUM INFORMATION PROCESSING, 2015, 14 (11) : 4001 - 4026
  • [29] Quantum image scaling up based on nearest-neighbor interpolation with integer scaling ratio
    Nan Jiang
    Jian Wang
    Yue Mu
    Quantum Information Processing, 2015, 14 : 4001 - 4026
  • [30] Scaling Support Vector Machines on modern HPC platforms
    You, Yang
    Fu, Haohuan
    Song, Shuaiwen Leon
    Randles, Amanda
    Kerbyson, Darren
    Marquez, Andres
    Yang, Guangwen
    Hoisie, Adolfy
    JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2015, 76 : 16 - 31