An enhanced random forest with canonical partial least squares for classification

被引:5
|
作者
Li, Chuan-Quan [1 ]
Lin, You-Wu [2 ]
Xu, Qing-Song [1 ]
机构
[1] Cent South Univ, Sch Math & Stat, Changsha 410083, Hunan, Peoples R China
[2] Guangxi Teachers Educ Univ, Sch Math & Stat, Nanning, Guangxi, Peoples R China
基金
中国国家自然科学基金;
关键词
Canonical partial least squares; random forest; classification; feature rotation; CLASSIFIERS; REGRESSION; ENSEMBLE;
D O I
10.1080/03610926.2020.1716249
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Recently, several variants of random forest have been derived for the classification problems, among which the rotation forest is an important type to improve the model's accuracy. In this article, we proposed a simple and effective variation of rotation forest, which the canonical partial least squares algorithm is employed to rotate the variable space of tree and then all the trees are combined being a "forest." Results of an experiment on a sample of 20 benchmark datasets show our method has better prediction performance comparing with random forest and rotation forest.
引用
收藏
页码:4324 / 4334
页数:11
相关论文
共 50 条
  • [41] Multimodal Classification of Mild Cognitive Impairment Based on Partial Least Squares
    Wang, Pingyue
    Chen, Kewei
    Yao, Li
    Hu, Bin
    Wu, Xia
    Zhang, Jiacai
    Ye, Qing
    Guo, Xiaojuan
    JOURNAL OF ALZHEIMERS DISEASE, 2016, 54 (01) : 359 - 371
  • [42] Computer aided diagnosis system for the Alzheimer's disease based on least squares and random forest SPECT image classification
    Ramirez, J.
    Gorriz, J. M.
    Segovia, F.
    Chaves, R.
    Salas-Gonzalez, D.
    Lopez, M.
    Alvarez, I.
    Padilla, P.
    NEUROSCIENCE LETTERS, 2010, 472 (02) : 99 - 103
  • [43] Least squares as random walks
    Kostinski, Alexander
    Ierley, Glenn
    Kostinski, Sarah
    PHYSICS LETTERS A, 2025, 545
  • [44] Comparing Canonical Correlation Analysis with Partial Least Squares Regression in Estimating Forest Leaf Area Index with Multitemporal Landsat TM Imagery
    Pu, Ruiliang
    GISCIENCE & REMOTE SENSING, 2012, 49 (01) : 92 - 116
  • [45] Partial-Least Squares
    Robins, James
    LONG RANGE PLANNING, 2012, 45 (5-6) : 309 - 311
  • [46] The geometry of partial least squares
    Phatak, A
    DeJong, S
    JOURNAL OF CHEMOMETRICS, 1997, 11 (04) : 311 - 338
  • [47] Partial least squares regression
    deJong, S
    Phatak, A
    RECENT ADVANCES IN TOTAL LEAST SQUARES TECHNIQUES AND ERRORS-IN-VARIABLES MODELING, 1997, : 25 - 36
  • [48] Nonlinear partial least squares
    Malthouse, EC
    Tamhane, AC
    Mah, RSH
    COMPUTERS & CHEMICAL ENGINEERING, 1997, 21 (08) : 875 - 890
  • [49] Multiview partial least squares
    Mou, Yi
    Zhou, Long
    You, Xinge
    Lu, Yaling
    Chen, Weizhen
    Zhao, Xu
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2017, 160 : 13 - 21
  • [50] Partial least squares for discrimination
    Barker, M
    Rayens, W
    JOURNAL OF CHEMOMETRICS, 2003, 17 (03) : 166 - 173