Improving the Performance of Machine Learning with Sequential Feature Selection and Grid Search

被引:0
|
作者
Assegie, Tsehay Admassu [1 ]
Murugan, Sangeetha [2 ]
Govindarajan, Rajkumar [3 ]
Napa, Komal Kumar [3 ]
D, D. [3 ]
机构
[1] Kyungpook Natl Univ, Sch Elect & Elect Engn, Daegu, South Korea
[2] Madanapalle Inst Technol & Sci, Dept Comp Sci & Engn, Madanapalle, Andhra Prades, India
[3] Madanapalle Inst Technol & Sci, Dept Comp Sci & Engn Data Sci, Madanapalle, Andhra Prades, India
来源
PRZEGLAD ELEKTROTECHNICZNY | 2024年 / 100卷 / 07期
关键词
K-Nearest Neighbors; parameter tuning; machine learning;
D O I
10.15199/48.2024.07.29
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Feature selection is an important step in developing accurate machine -learning models for classification tasks, including wine quality prediction. The accuracy of the machine learning model depends on the selection of relevant features that contribute to the predicted outcome. In this paper, we propose two commonly used optimization methods, forward sequential feature selection (SFS), and grid search, to identify the most relevant features for wine quality prediction using K -nearest neighbor (KNN). We used a dataset of 1598 samples with 11 wine -quality features and evaluated the performance of the KNN model trained on different subsets of features selected SFS. The result suggests that SFS and gird search are effective methods for wine quality prediction using KNN. The identified wine quality features help to predict the quality of wine more accurately, leading to better predictive outcomes. Thus, machine learning models can benefit greatly from the use of grid search and SFS. By fine-tuning the model in this way, it is possible to achieve better results in applications where accuracy and speed are important. As machine learning continues to be used in a wide range of industries, the use of these techniques will become increasingly important. Further research is needed to validate the model on larger datasets and to integrate it into practical classification or predictive analysis.
引用
收藏
页码:140 / 143
页数:4
相关论文
共 50 条
  • [1] Improving the performance of machine learning classifiers for Breast Cancer diagnosis based on feature selection
    Perez, Noel
    Guevara, Miguel A.
    Silva, Augusto
    Ramos, Isabel
    Loureiro, Joana
    [J]. FEDERATED CONFERENCE ON COMPUTER SCIENCE AND INFORMATION SYSTEMS, 2014, 2014, 2 : 209 - 217
  • [2] Feature selection in machine learning via variable neighborhood search
    Mujahid N. Syed
    [J]. Optimization Letters, 2023, 17 : 2321 - 2345
  • [3] Feature selection in machine learning via variable neighborhood search
    Syed, Mujahid N.
    [J]. OPTIMIZATION LETTERS, 2023, 17 (09) : 2321 - 2345
  • [4] Improving performance with hybrid feature selection and ensemble machine learning techniques for code smell detection
    Jain, Shivani
    Saha, Anju
    [J]. SCIENCE OF COMPUTER PROGRAMMING, 2021, 212
  • [5] Sequential Genetic Search for Ensemble Feature Selection
    Tsymbal, Alexey
    Pechenizkiy, Mykola
    Cunningham, Padraig
    [J]. 19TH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI-05), 2005, : 877 - 882
  • [6] Feature Selection by Merging Sequential Bidirectional Search into Relevance Vector Machine in Condition Monitoring
    ZHANG Kui
    DONG Yu
    BALL Andrew
    [J]. Chinese Journal of Mechanical Engineering, 2015, 28 (06) : 1248 - 1253
  • [7] Feature selection by merging sequential bidirectional search into relevance vector machine in condition monitoring
    Kui Zhang
    Yu Dong
    Andrew Ball
    [J]. Chinese Journal of Mechanical Engineering, 2015, 28 : 1248 - 1253
  • [8] Feature Selection by Merging Sequential Bidirectional Search into Relevance Vector Machine in Condition Monitoring
    Zhang Kui
    Dong Yu
    Ball, Andrew
    [J]. CHINESE JOURNAL OF MECHANICAL ENGINEERING, 2015, 28 (06) : 1248 - 1253
  • [9] Improving backpropagation learning with feature selection
    Setiono, R
    Liu, H
    [J]. APPLIED INTELLIGENCE, 1996, 6 (02) : 129 - 139
  • [10] Probabilistic Feature Selection in Machine Learning
    Ghosh, Indrajit
    [J]. ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2018, PT I, 2018, 10841 : 623 - 632