An enhanced random forest with canonical partial least squares for classification

被引:5
|
作者
Li, Chuan-Quan [1 ]
Lin, You-Wu [2 ]
Xu, Qing-Song [1 ]
机构
[1] Cent South Univ, Sch Math & Stat, Changsha 410083, Hunan, Peoples R China
[2] Guangxi Teachers Educ Univ, Sch Math & Stat, Nanning, Guangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Canonical partial least squares; random forest; classification; feature rotation; CLASSIFIERS; REGRESSION; ENSEMBLE;
D O I
10.1080/03610926.2020.1716249
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Recently, several variants of random forest have been derived for the classification problems, among which the rotation forest is an important type to improve the model's accuracy. In this article, we proposed a simple and effective variation of rotation forest, which the canonical partial least squares algorithm is employed to rotate the variable space of tree and then all the trees are combined being a "forest." Results of an experiment on a sample of 20 benchmark datasets show our method has better prediction performance comparing with random forest and rotation forest.
引用
收藏
页码:4324 / 4334
页数:11
相关论文
共 50 条
  • [1] Random Forest Regression Based on Partial Least Squares
    Hao, Zhulin
    Du, Jianqiang
    Nie, Bin
    Yu, Fang
    Yu, Riyue
    Xiong, Wangping
    PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE: TECHNOLOGIES AND APPLICATIONS, 2016, 127
  • [2] OBLIQUE RANDOM FOREST BASED ON PARTIAL LEAST SQUARES APPLIED TO PEDESTRIAN DETECTION
    Lima Correia, Artur Jordao
    Schwartz, William Robson
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 2931 - 2935
  • [3] Canonical partial least squares-a unified PLS approach to classification and regression problems
    Indahl, Ulf G.
    Liland, Kristian Hovde
    Naes, Tormod
    JOURNAL OF CHEMOMETRICS, 2009, 23 (9-10) : 495 - 504
  • [4] Canonical partial least squares and continuum power regression
    de Jong, S
    Wise, BM
    Ricker, NL
    JOURNAL OF CHEMOMETRICS, 2001, 15 (02) : 85 - 100
  • [5] Extension of pQSAR: Ensemble Model Generated by Random Forest and Partial Least Squares Regressions
    Kim, Byung Chun
    Joe, Dosang
    Woo, Youngho
    Kim, Yongkuk
    Yoon, Gangjoon
    IEEE ACCESS, 2020, 8 : 180087 - 180099
  • [6] Protein family classification with partial least squares
    Opiyo, Stephen O.
    Moriyama, Etsuko N.
    JOURNAL OF PROTEOME RESEARCH, 2007, 6 (02) : 846 - 853
  • [7] Classification using generalized partial least squares
    Ding, BY
    Gentleman, R
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2005, 14 (02) : 280 - 298
  • [8] Identification of Boletus Species Based on Discriminant Analysis of Partial Least Squares and Random Forest Algorithm
    Chen Feng-xia
    Yang Tian-wei
    Li Jie-qing
    Liu Hong-gao
    Fan Mao-pan
    Wang Yuan-zhong
    SPECTROSCOPY AND SPECTRAL ANALYSIS, 2022, 42 (02) : 549 - 554
  • [9] Prediction of Grape Sap Flow in a Greenhouse Based on Random Forest and Partial Least Squares Models
    Peng, Xuelian
    Hu, Xiaotao
    Chen, Dianyu
    Zhou, Zhenjiang
    Guo, Yinyin
    Deng, Xin
    Zhang, Xingguo
    Yu, Tinggao
    WATER, 2021, 13 (21)
  • [10] An Enhanced Kernel Partial Least-Squares Fault Reconstruction Fused With Pattern Classification
    Liu, Meizhi
    Kong, Xiangyu
    Hu, Changhua
    Li, Hongzeng
    Wang, Ziwen
    IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2025,