Survey of research on application of heuristic algorithm in machine learning

被引：0
|
作者：
Shen Y. [1 ,2 ]
Zheng K. [1 ]
Wu C. [1 ]
Yang Y. [1 ]
机构：
[1] School of Cyberspace Security, Beijing University of Posts and Telecommunications, Beijing
[2] School of Information Engineering, Institute of Disaster Prevention, Langfang
来源：
Tongxin Xuebao/Journal on Communications | 2019年 / 40卷 / 12期
基金：
中国国家自然科学基金;
关键词：
Ensemble pruning; Feature optimization; Kernel function learning; Parameter and structure optimization; Prototype optimization; Weighted voting ensemble;
D O I：
10.11959/j.issn.1000-436x.2019242
中图分类号：
学科分类号：
摘要：
Aiming at the problems existing in the application of machine learning algorithm, an optimization system of the machine learning model based on the heuristic algorithm was constructed. Firstly, the existing types of heuristic algorithms and the modeling process of heuristic algorithms were introduced. Then, the advantages of the heuristic algorithm were illustrated from its applications in machine learning, including the parameter and structure optimization of neural network and other machine learning algorithms, feature optimization, ensemble pruning, prototype optimization, weighted voting ensemble and kernel function learning. Finally, the heuristic algorithms and their development directions in the field of machine learning were given according to the actual needs. © 2019, Editorial Board of Journal on Communications. All right reserved.
引用
收藏
页码：124 / 137
页数：13
相关论文
共 95 条
  • [31] He S., Wu Q.H., Saunders J.R., Group search optimizer: an optimization algorithm inspired by animal searching behavior, IEEE Transactions on Evolutionary Computation, 13, 5, pp. 973-990, (2009)
  • [32] Wolpert D.H., Macready W.G., No free lunch theorems for optimization, IEEE Transactions on Evolutionary Computation, 1, 1, pp. 67-82, (1997)
  • [33] Koza J.R., Genetic programming: a paradigm for genetically breeding populations of computer programs to solve problems, (1990)
  • [34] Mahdavi S., Shiri M.E., Rahnamayan S., Metaheuristics in large-scale global continues optimization: a survey, Information Sciences, 295, pp. 407-428, (2015)
  • [35] Ali M., Mhoammed B.A.D., Ismail A., Et al., A new intrusion detection system based on fast learning network and particle swarm optimization, IEEE Access, PP, 99, (2018)
  • [36] Xia H., Hoi S.C.H., MKBoost: a framework of multiple kernel boosting, IEEE Transactions on Knowledge and Data Engineering, 25, 7, pp. 1574-1586, (2013)
  • [37] Young S.R., Rose D.C., Karnowski T.P., Et al., Optimizing deep learning hyper-parameters through an evolutionary algorithm, The Workshop on Machine Learning in High-Performance Computing Environments, pp. 1-5, (2015)
  • [38] Ahila R., Sadasivam V., Manimala K., An integrated PSO for parameter determination and feature selection of ELM and its application in classification of power system disturbances, Applied Soft Computing, 32, pp. 23-37, (2015)
  • [39] Zhu Q., Qin A., Suganthan P., Et al., Evolutionary extreme learning machine, Pattern Recognition, 38, 10, pp. 1759-1763, (2005)
  • [40] Zhang Y., Wu J., Cai Z., Et al., Memetic extreme learning machine, Pattern Recognition, 58, pp. 135-148, (2016)
12345678910