Optimization of parallel random forest algorithm based on distance weight

被引:13
|
作者
Wang, Qinge [1 ]
Chen, Huihua [1 ]
机构
[1] Cent South Univ, Sch Civil Engn, Changsha, Peoples R China
基金
中国国家自然科学基金;
关键词
Distance weights; parallel algorithm; random forest algorithm; algorithm optimization;
D O I
10.3233/JIFS-179965
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to overcome the problems of long execution time and low parallelism of existing parallel random forest algorithms, an optimization method for parallel random forest algorithm based on distance weights is proposed. The concept of distance weights is introduced to optimize the algorithm. Firstly, the training sample data are extracted from the original data set by random selection. Based on the extracted results, a single decision tree is constructed. The single decision tree is grouped together according to different grouping methods to form a random forest. The distance weights of the training sample data set are calculated, and then the weighted optimization of the random forest model is realized. The experimental results show that the execution time of the parallel random forest algorithm after optimization is 110 000 ms less than that before optimization, and the operation efficiency of the algorithm is greatly improved, which effectively solves the problems existing in the traditional random forest algorithm.
引用
收藏
页码:1951 / 1963
页数:13
相关论文
共 50 条
  • [1] Parallel Random Forest Algorithm Optimization Based on Maximal Information Coefficient
    Liu, Song
    Hu, TianYu
    [J]. PROCEEDINGS OF 2018 IEEE 9TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS), 2018, : 1083 - 1087
  • [2] A Fast Parallel Random Forest Algorithm Based on Spark
    Yin, Linzi
    Chen, Ken
    Jiang, Zhaohui
    Xu, Xuemei
    [J]. APPLIED SCIENCES-BASEL, 2023, 13 (10):
  • [3] Optimization of the Random Forest Algorithm
    Mohapatra, Niva
    Shreya, K.
    Chinmay, Ayes
    [J]. ADVANCES IN DATA SCIENCE AND MANAGEMENT, 2020, 37 : 201 - 208
  • [4] Research on Optimization of Random Forest Algorithm Based on Spark
    Wang, Suzhen
    Zhang, Zhanfeng
    Geng, Shanshan
    Pang, Chaoyi
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 71 (02): : 3721 - 3731
  • [5] An adaptive weight adjustment algorithm based on optimization of weight distance similarity
    Yang, Ningguo
    Ren, Xintao
    Zhang, Jianwei
    Jiang, Weibing
    [J]. PROCEEDINGS OF THE 2017 3RD INTERNATIONAL FORUM ON ENERGY, ENVIRONMENT SCIENCE AND MATERIALS (IFEESM 2017), 2017, 120 : 587 - 591
  • [6] Parallel label propagation algorithm based on weight and random walk
    Tang, Meili
    Pan, Qian
    Qian, Yurong
    Tian, Yuan
    Al-Nabhan, Najla
    Wang, Xin
    [J]. MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2021, 18 (02) : 1609 - 1628
  • [7] Optimization of Entrepreneurship Education for College Students Based on Improved Random Forest Algorithm
    Jia, Dongfeng
    Zhao, Hui
    [J]. MOBILE INFORMATION SYSTEMS, 2022, 2022
  • [8] Research on power line communication optimization algorithm based on improved random forest
    Xie, Wenwang
    Sun, Yunlian
    Huang, Yaxin
    [J]. Dianli Xitong Baohu yu Kongzhi/Power System Protection and Control, 2019, 47 (11): : 22 - 29
  • [9] Wind Power Forecasting Using Parallel Random Forest Algorithm
    Natarajan, V. Anantha
    Kumari, N. Sandhya
    [J]. SOFT COMPUTING FOR PROBLEM SOLVING, SOCPROS 2018, VOL 1, 2020, 1048 : 209 - 224
  • [10] High-precision positioning algorithm for UAV based on random forest weight compensation
    Fang, Kun
    Li, Xiaohui
    Fan, Tao
    [J]. Xi Tong Gong Cheng Yu Dian Zi Ji Shu/Systems Engineering and Electronics, 2023, 45 (01): : 202 - 209