Feature-weighted K-nearest neighbor algorithm with SVM

被引：0

作者：

Chen, Zhen-Zhou ^{[1
,2
]}

Li, Lei ^{[1
]}

Yao, Zheng-An ^{[2
]}

机构：

[1] Inst. of Software, Sun Yat-sen Univ., Guangzhou 510275, China

[2] Sch. of Math. and Comp. Sci., Sun Yat-sen Univ., Guangzhou 510275, China

来源：

Zhongshan Daxue Xuebao/Acta Scientiarum Natralium Universitatis Sunyatseni | 2005年 / 44卷 / 01期

关键词：

Classification (of information) - Database systems - Finite automata - Learning systems - Pattern recognition - Regression analysis;

D O I：

暂无

中图分类号：

学科分类号：

摘要：

As a nonparametric approach, K-Nearest Neighbor (K-NN) algorithm is very efficient and easily to be realized. The k-NN algorithm has been successfully used in classification, regression and pattern recognition. Two aspects, the weight of samples and the weight of features, must be paid attention to when applying K-NN to solve problems. SVM (support vector machine) to quantify the weight of features was used and FWKNN (feature-weighted K-nearest neighbor algorithm with SVM) was proposed. Experiments on artificial and natural datasets FWKNN show that, in most cases, FWKNN improve the accuracy of classification.

引用

页码：17 / 20

共 50 条

[1] Feature-weighted k-nearest neighbor classifier
Vivencio, Diego P.
Hruschka, Estevarn R., Jr.
Nicoletti, M. do Carmo
dos Santos, Edimilson B.
Galvao, Sebastian D. C. O.
[J]. 2007 IEEE SYMPOSIUM ON FOUNDATIONS OF COMPUTATIONAL INTELLIGENCE, VOLS 1 AND 2, 2007, : 481 - +
[2] A feature weighted K-nearest neighbor algorithm based on association rules
Manzali Y.
Barry K.A.
Flouchi R.
Balouki Y.
Elfar M.
[J]. Journal of Ambient Intelligence and Humanized Computing, 2024, 15 (07) : 2995 - 3008
[3] Applying Feature-Weighted Gradient Decent K-Nearest Neighbor to Select Promising Projects for Scientific Funding
Zhang, Chuqing
Yao, Jiangyuan
Hu, Guangwu
Schott, Thomas
[J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2020, 64 (03): : 1741 - 1753
[4] An Improved Weighted K-Nearest Neighbor Algorithm for Indoor Positioning
Changgeng Li
Zhengyang Qiu
Changtong Liu
[J]. Wireless Personal Communications, 2017, 96 : 2239 - 2251
[5] Weighted K-Nearest Neighbor Revisited
Bicego, M.
Loog, M.
[J]. 2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 1642 - 1647
[6] An Improved Weighted K-Nearest Neighbor Algorithm for Indoor Localization
Peng, Xuesheng
Chen, Ruizhi
Yu, Kegen
Ye, Feng
Xue, Weixing
[J]. ELECTRONICS, 2020, 9 (12) : 1 - 14
[7] An Improved Weighted K-Nearest Neighbor Algorithm for Indoor Positioning
Li, Changgeng
Qiu, Zhengyang
Liu, Changtong
[J]. WIRELESS PERSONAL COMMUNICATIONS, 2017, 96 (02) : 2239 - 2251
[8] Overcoming Feature Drifts via Dynamic Feature Weighted k-Nearest Neighbor Learning
Barddal, Jean Paul
Gomes, Heitor Murilo
Granatyr, Jones
Britto, Alceu de Souza, Jr.
Enembreck, Fabricio
[J]. 2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 2186 - 2191
[9] Quantum K-nearest neighbor algorithm
Chen, Hanwu
Gao, Yue
Zhang, Jun
[J]. Dongnan Daxue Xuebao (Ziran Kexue Ban)/Journal of Southeast University (Natural Science Edition), 2015, 45 (04): : 647 - 651
[10] A FUZZY K-NEAREST NEIGHBOR ALGORITHM
KELLER, JM
GRAY, MR
GIVENS, JA
[J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1985, 15 (04): : 580 - 585

← 1 2 3 4 5 →