An advanced ACO algorithm for feature subset selection

被引:224
|
作者
Kashef, Shima [1 ]
Nezamabadi-pour, Hossein [1 ]
机构
[1] Shahid Bahonar Univ Kerman, Dept Elect Engn, Kerman, Iran
关键词
Feature selection; Wrapper; Ant colony optimization (ACO); Binary ACO; Classification; ANT COLONY OPTIMIZATION; PARTICLE SWARM OPTIMIZATION; HYBRID GENETIC ALGORITHM; NEURAL-NETWORKS;
D O I
10.1016/j.neucom.2014.06.067
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Feature selection is an important task for data analysis and information retrieval processing, pattern classification systems, and data mining applications. It reduces the number of features by removing noisy, irrelevant and redundant data. In this paper, a novel feature selection algorithm based on Ant Colony Optimization (ACO), called Advanced Binary ACO (ABACO), is presented. Features are treated as graph nodes to construct a graph model and are fully connected to each other. In this graph, each node has two sub-nodes, one for selecting and the other for deselecting the feature. Ant colony algorithm is used to select nodes while ants should visit all features. The use of several statistical measures is examined as the heuristic function for visibility of the edges in the graph. At the end of a tour, each ant has a binary vector with the same length as the number of features, where 1 implies selecting and 0 implies deselecting the corresponding feature. The performance of proposed algorithm is compared to the performance of Binary Genetic Algorithm (BGA), Binary Particle Swarm Optimization (BPSO), CatfishBPSO, Improved Binary Gravitational Search Algorithm (IBGSA), and some prominent ACO-based algorithms on the task of feature selection on 12 well-known UCI datasets. Simulation results verify that the algorithm provides a suitable feature subset with good classification accuracy using a smaller feature set than competing feature selection methods. (C) 2014 Elsevier B.V. All rights reserved.
引用
收藏
页码:271 / 279
页数:9
相关论文
共 50 条
  • [1] Experimental comparison of feature subset selection using GA and ACO algorithm
    Lee, Keunjoon
    Joo, Jinu
    Yang, Jihoon
    Honavar, Vasant
    [J]. ADVANCED DATA MINING AND APPLICATIONS, PROCEEDINGS, 2006, 4093 : 465 - 472
  • [2] THE FEATURE SUBSET SELECTION ALGORITHM
    Liu Yongguo Li Xueming Wu Zhongfu (Department of Computer Science and Engineering
    [J]. Journal of Electronics(China), 2003, (01) : 57 - 61
  • [3] Feature subset selection using a genetic algorithm
    Yang, JH
    Honavar, V
    [J]. IEEE INTELLIGENT SYSTEMS & THEIR APPLICATIONS, 1998, 13 (02): : 44 - 49
  • [4] A neuro fuzzy algorithm for feature subset selection
    Chakraborty, B
    Chakraborty, G
    [J]. IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2001, E84A (09): : 2182 - 2188
  • [5] BRANCH AND BOUND ALGORITHM FOR FEATURE SUBSET SELECTION
    NARENDRA, P
    FUKUNAGA, K
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 1977, 26 (09) : 917 - 922
  • [6] A thermodynamical search algorithm for feature subset selection
    Gonzalez, Felix F.
    Belanche, Lluis A.
    [J]. NEURAL INFORMATION PROCESSING, PART I, 2008, 4984 : 683 - 692
  • [7] A hierarchy reduct algorithm for feature subset selection
    Qu, BB
    Lu, YS
    [J]. PROCEEDINGS OF THE 2004 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2004, : 1157 - 1161
  • [8] Feature subset selection based on the genetic algorithm
    Yang, Jingwei
    Wang, Sile
    Chen, Yingyi
    Lu, Sukui
    Yang, Wenzhu
    [J]. ADVANCED TECHNOLOGIES IN MANUFACTURING, ENGINEERING AND MATERIALS, PTS 1-3, 2013, 774-776 : 1532 - +
  • [9] IMPROVED FORWARD FLOATING SELECTION ALGORITHM FOR FEATURE SUBSET SELECTION
    Nakariyakul, Songyot
    Casasent, David P.
    [J]. PROCEEDINGS OF 2008 INTERNATIONAL CONFERENCE ON WAVELET ANALYSIS AND PATTERN RECOGNITION, VOLS 1 AND 2, 2008, : 793 - +
  • [10] Fast orthogonal forward selection algorithm for feature subset selection
    Mao, KZ
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (05): : 1218 - 1224