Weighted Hybrid Decision Tree Model for Random Forest Classifier

被引:24
|
作者
Kulkarni V.Y. [1 ]
Sinha P.K. [2 ]
Petare M.C. [3 ]
机构
[1] Department of Computer Engineering, Maharashtra Institute of Technology, Pune, Maharashtra
[2] Centre for Development of Advanced Computing, Pune
[3] Department of Computer Engineering, Progressive Education Society’s Modern College of Engineering, Pune, Maharashtra
关键词
Attribute split measure; Classification; Decision tree; Ensemble; Random forest;
D O I
10.1007/s40031-014-0176-y
中图分类号
学科分类号
摘要
Random Forest is an ensemble, supervised machine learning algorithm. An ensemble generates many classifiers and combines their results by majority voting. Random forest uses decision tree as base classifier. In decision tree induction, an attribute split/evaluation measure is used to decide the best split at each node of the decision tree. The generalization error of a forest of tree classifiers depends on the strength of the individual trees in the forest and the correlation among them. The work presented in this paper is related to attribute split measures and is a two step process: first theoretical study of the five selected split measures is done and a comparison matrix is generated to understand pros and cons of each measure. These theoretical results are verified by performing empirical analysis. For empirical analysis, random forest is generated using each of the five selected split measures, chosen one at a time. i.e. random forest using information gain, random forest using gain ratio, etc. The next step is, based on this theoretical and empirical analysis, a new approach of hybrid decision tree model for random forest classifier is proposed. In this model, individual decision tree in Random Forest is generated using different split measures. This model is augmented by weighted voting based on the strength of individual tree. The new approach has shown notable increase in the accuracy of random forest. © 2014, The Institution of Engineers (India).
引用
收藏
页码:209 / 217
页数:8
相关论文
共 50 条
  • [1] A hybrid decision tree classifier
    Kotsiantis, Sotiris
    [J]. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2014, 26 (01) : 327 - 336
  • [2] Fault Diagnosis in Power Transmission Line using Decision Tree and Random Forest Classifier
    Chakravarty, Somesh Lahiri
    Maiti, Abhijnan
    De, Abhinandan
    [J]. 2022 IEEE 6TH INTERNATIONAL CONFERENCE ON CONDITION ASSESSMENT TECHNIQUES IN ELECTRICAL SYSTEMS, CATCON, 2022, : 57 - 61
  • [3] A general model for fuzzy decision tree and fuzzy random forest
    Zheng, Hui
    He, Jing
    Zhang, Yanchun
    Huang, Guangyan
    Zhang, Zhenjiang
    Liu, Qing
    [J]. COMPUTATIONAL INTELLIGENCE, 2019, 35 (02) : 310 - 335
  • [4] A hybrid genetic algorithm - Decision tree classifier
    Salem, ABM
    Mahmoud, AM
    [J]. INTELLIGENT INFORMATION PROCESSING AND WEB MINING, 2003, : 221 - 232
  • [5] Text document categorisation using random forest and C4.5 decision tree classifier
    Pawar, Sumathi
    Rao, Manjula Gururaj
    Pandith, Karuna
    [J]. International Journal of Computational Systems Engineering, 2023, 7 (2-4) : 211 - 220
  • [6] A Practical Differentially Private Random Decision Tree Classifier
    Jagannathan, Geetha
    Pillaipakkamnatt, Krishnan
    Wright, Rebecca N.
    [J]. TRANSACTIONS ON DATA PRIVACY, 2012, 5 (01) : 273 - 295
  • [7] A Practical Differentially Private Random Decision Tree Classifier
    Jagannathan, Geetha
    Pillaipakkamnatt, Krishnan
    Wright, Rebecca N.
    [J]. 2009 IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS (ICDMW 2009), 2009, : 114 - +
  • [8] A Detailed Review on Decision Tree and Random Forest
    Talekar, Bhusban
    Agrawal, Sachin
    [J]. BIOSCIENCE BIOTECHNOLOGY RESEARCH COMMUNICATIONS, 2020, 13 (14): : 245 - 248
  • [9] Combining Optical Coherence Topography measurements using the 'Random Forest' decision tree classifier improves the diagnosis of glaucoma
    Sugimoto, Koichiro
    Murata, Hiroshi
    Hirasawa, Hiroyo
    Mayama, Chihiro
    Aihara, Makoto
    Asaoka, Ryo
    [J]. INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2013, 54 (15)
  • [10] Semi-Supervised Self-Training Feature Weighted Clustering Decision Tree and Random Forest
    Liu, Zhenyu
    Wen, Tao
    Sun, Wei
    Zhang, Qilong
    [J]. IEEE ACCESS, 2020, 8 (08): : 128337 - 128348