Feature-weighted K-nearest neighbor algorithm with SVM

被引:0
|
作者
Chen, Zhen-Zhou [1 ,2 ]
Li, Lei [1 ]
Yao, Zheng-An [2 ]
机构
[1] Inst. of Software, Sun Yat-sen Univ., Guangzhou 510275, China
[2] Sch. of Math. and Comp. Sci., Sun Yat-sen Univ., Guangzhou 510275, China
关键词
Classification (of information) - Database systems - Finite automata - Learning systems - Pattern recognition - Regression analysis;
D O I
暂无
中图分类号
学科分类号
摘要
As a nonparametric approach, K-Nearest Neighbor (K-NN) algorithm is very efficient and easily to be realized. The k-NN algorithm has been successfully used in classification, regression and pattern recognition. Two aspects, the weight of samples and the weight of features, must be paid attention to when applying K-NN to solve problems. SVM (support vector machine) to quantify the weight of features was used and FWKNN (feature-weighted K-nearest neighbor algorithm with SVM) was proposed. Experiments on artificial and natural datasets FWKNN show that, in most cases, FWKNN improve the accuracy of classification.
引用
收藏
页码:17 / 20
相关论文
共 50 条
  • [41] NOTE ON DISTANCE-WEIGHTED K-NEAREST NEIGHBOR RULES
    BAILEY, T
    JAIN, AK
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1978, 8 (04): : 311 - 313
  • [42] On kernel difference-weighted k-nearest neighbor classification
    Zuo, Wangmeng
    Zhang, David
    Wang, Kuanquan
    PATTERN ANALYSIS AND APPLICATIONS, 2008, 11 (3-4) : 247 - 257
  • [43] Hybrid Metric K-Nearest Neighbor Algorithm and Applications
    Zhang, Chao
    Zhong, Peisi
    Liu, Mei
    Song, Qingjun
    Liang, Zhongyuan
    Wang, Xiao
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022
  • [44] KNNCC: An Algorithm for K-Nearest Neighbor Clique Clustering
    Qu Chao
    Yuan Ruifen
    Wei Xiaorui
    PROCEEDINGS OF 2013 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), VOLS 1-4, 2013, : 1763 - 1766
  • [45] K-Nearest Neighbor Algorithm Optimization in Text Categorization
    Chen, Shufeng
    2017 3RD INTERNATIONAL CONFERENCE ON ENVIRONMENTAL SCIENCE AND MATERIAL APPLICATION (ESMA2017), VOLS 1-4, 2018, 108
  • [46] Random K-nearest neighbor algorithm with learning process
    Fu Z.-L.
    Chen X.-Q.
    Ren W.
    Yao Y.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2024, 54 (01): : 209 - 220
  • [47] An instance selection algorithm for fuzzy K-nearest neighbor
    Zhai, Junhai
    Qi, Jiaxing
    Zhang, Sufang
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2021, 40 (01) : 521 - 533
  • [48] Optimization of the Neighbor Parameter of k-Nearest Neighbor Algorithm for Collaborative Filtering
    Vaghela, Vimalkumar B.
    Pathak, Himalay H.
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON COMMUNICATION AND NETWORKS, 2017, 508 : 87 - 93
  • [49] K-Nearest Neighbor Classifier for Uncertain Data in Feature Space
    Lim, Sung-Yeon
    Ko, Changwan
    Jeong, Young-Seon
    Baek, Jaeseung
    INDUSTRIAL ENGINEERING AND MANAGEMENT SYSTEMS, 2023, 22 (04): : 414 - 421
  • [50] GM(1,1)-Based Weighted K-Nearest Neighbor Algorithm for Indoor Localization
    Xiang, Lai
    Xu, Ying
    Cui, Jianhui
    Liu, Yang
    Wang, Ruozhou
    Li, Guofeng
    REMOTE SENSING, 2023, 15 (15)