Application and comparison of several machine learning algorithms and their integration models in regression problems

被引:77
|
作者
Huang, Jui-Chan [1 ]
Ko, Kuo-Min [1 ]
Shu, Ming-Hung [2 ,4 ]
Hsu, Bi-Min [3 ]
机构
[1] Yango Univ, Fuzhou 350015, Fujian, Peoples R China
[2] Natl Kaohsiung Univ Sci & Technol, Dept Ind Engn & Management, Kaohsiung 80778, Taiwan
[3] Cheng Shiu Univ, Dept Ind Engn & Management, Kaohsiung, Taiwan
[4] Kaohsiung Med Univ, Dept Healthcare Adm & Med Informat, Kaohsiung 80778, Taiwan
来源
NEURAL COMPUTING & APPLICATIONS | 2020年 / 32卷 / 10期
关键词
Machine learning; Regression problem; BP neural network; Extreme learning machine; Support vector machine;
D O I
10.1007/s00521-019-04644-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of machine learning technology, as a regression problem that helps people to find the law from the massive data to achieve the prediction effect, more and more people pay attention. Data prediction has become an important part of people's daily life. Currently, the technology is widely used in many fields such as weather forecasting, medical diagnosis and financial forecasting. Therefore, the research of machine learning algorithms in regression problems is a research hotspot in the field of machine learning in recent years. However, real-world regression problems often have very complex internal and external factors, and various machine learning algorithms have different effects on scalability and predictive performance. In order to better study the application effect of machine learning algorithm in regression problem, this paper mainly adopts three common machine learning algorithms: BP neural network, extreme learning machine and support vector machine. Then, by comparing the effects of the single model and integrated model of these machine learning algorithms in the application of regression problems, the advantages and disadvantages of each machine learning algorithm are studied. Finally, the performance of each machine learning algorithm in regression prediction is verified by simulation experiments on four different data sets. The results show that the research on several machine learning algorithms and their integration models has certain feasibility and rationality.
引用
收藏
页码:5461 / 5469
页数:9
相关论文
共 50 条
  • [1] Application and comparison of several machine learning algorithms and their integration models in regression problems
    Jui-Chan Huang
    Kuo-Min Ko
    Ming-Hung Shu
    Bi-Min Hsu
    [J]. Neural Computing and Applications, 2020, 32 : 5461 - 5469
  • [2] Application of machine learning regression models to inverse eigenvalue problems
    Pallikarakis, Nikolaos
    Ntargaras, Andreas
    [J]. COMPUTERS & MATHEMATICS WITH APPLICATIONS, 2024, 154 : 162 - 174
  • [3] Selecting Machine Learning Algorithms using Regression Models
    Doan, Tri
    Kalita, Jugal
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOP (ICDMW), 2015, : 1498 - 1505
  • [4] Comparison of Machine Learning Algorithms for Classification Problems
    Sekeroglu, Boran
    Hasan, Shakar Sherwan
    Abdullah, Saman Mirza
    [J]. ADVANCES IN COMPUTER VISION, VOL 2, 2020, 944 : 491 - 499
  • [5] Functional Outcome Prediction in Ischemic Stroke: A Comparison of Machine Learning Algorithms and Regression Models
    Alaka, Shakiru A.
    Menon, Bijoy K.
    Brobbey, Anita
    Williamson, Tyler
    Goyal, Mayank
    Demchuk, Andrew M.
    Hill, Michael D.
    Sajobi, Tolulope T.
    [J]. FRONTIERS IN NEUROLOGY, 2020, 11
  • [6] Statistical models and learning algorithms for ordinal regression problems
    Kanamori, Takafumi
    [J]. INFORMATION FUSION, 2013, 14 (02) : 199 - 207
  • [7] Nonparametric Statistical Analysis of Machine Learning Algorithms for Regression Problems
    Graczyk, Magdalena
    Lasota, Tadeusz
    Telec, Zbigniew
    Trawinski, Bogdan
    [J]. KNOWLEDGE-BASED AND INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS, PT I, 2010, 6276 : 111 - +
  • [8] Comparison of machine learning regression algorithms for foot placement prediction
    Chen, Xinxing
    Liu, Zijian
    Zhu, Jiale
    Zhang, Kuangen
    Leng, Yuquan
    Fu, Chenglong
    [J]. 2021 27TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE (M2VIP), 2021,
  • [9] Application of machine learning algorithms in multimodal integration of precipitation and temperature
    Ju, Qin
    Wu, Jinyu
    Wang, Xingping
    Liu, Xiaoni
    Wang, Yifu
    Duan, Yuanqiang
    Wu, Kexin
    Jiang, Xiaolei
    [J]. Water Resources Protection, 2024, 40 (03) : 106 - 115
  • [10] Comparison of Machine Learning Algorithms for Application in Antenna Design
    Faustino, E.
    Melo, M. C.
    Buarque, P.
    Bastos-Filho, Carmelo J. A.
    Cerqueira, Arismar S., Jr.
    Barboza, Erick A.
    [J]. 2021 SBMO/IEEE MTT-S INTERNATIONAL MICROWAVE AND OPTOELECTRONICS CONFERENCE (IMOC), 2021,