Investigation of a hybrid algorithm for decision tree generation

被引:0
|
作者
Kornienko, Y [1 ]
Borisov, A [1 ]
机构
[1] Riga Tech Univ, Inst Informat Technol, LV-1658 Riga, Latvia
关键词
genetic algorithm; ID3; machine learning; hill-climbing; ensembles of classifiers;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The paper describes experiments with Machine Learning. algorithms (ID3, C4.5, Bagged-C4.5, Boosted-C4.5 and Naive Bayes) and an algorithm made on the basis of a combination of genetic algorithms (GA) and ID3. To perform the experiments, the latter algorithm is implemented as an extension of the MLC++ Library of Stanford University. The behaviour of the algorithm is tested using 24 databases including the databases with a large number of attributes. It is shown that owing to "hill-climbing." problem solving, the characteristics of the classifier made with the help of the new algorithm became significantly better. The behaviour of the algorithm is examined when constructing pruned classifiers. The,ways to improve standard Machine Learning algorithms are suggested.
引用
收藏
页码:63 / 68
页数:6
相关论文
共 50 条
  • [1] A hybrid genetic algorithm - Decision tree classifier
    Salem, ABM
    Mahmoud, AM
    [J]. INTELLIGENT INFORMATION PROCESSING AND WEB MINING, 2003, : 221 - 232
  • [2] Decision Tree Generation Algorithm without Pruning
    Gao Jing
    [J]. MACHINERY ELECTRONICS AND CONTROL ENGINEERING III, 2014, 441 : 731 - 737
  • [3] A hybrid decision tree/genetic algorithm method for data mining
    Carvalho, DR
    Freitas, AA
    [J]. INFORMATION SCIENCES, 2004, 163 (1-3) : 13 - 35
  • [4] A DECISION TREE ALGORITHM FOR SQUARING HISTOGRAMS IN RANDOM NUMBER GENERATION
    TSANG, WW
    MARSAGLIA, G
    [J]. ARS COMBINATORIA, 1987, 23A : 291 - 301
  • [5] Software risk prediction based on the hybrid algorithm of genetic algorithm and decision tree
    Xu, Zhihong
    Yang, Bingbing
    Guo, Ping
    [J]. ADVANCED INTELLIGENT COMPUTING THEORIES AND APPLICATIONS: WITH ASPECTS OF CONTEMPORARY INTELLIGENT COMPUTING TECHNIQUES, 2007, 2 : 266 - +
  • [6] Hybrid decision tree
    Zhou, ZH
    Chen, ZQ
    [J]. KNOWLEDGE-BASED SYSTEMS, 2002, 15 (08) : 515 - 528
  • [7] New results for a hybrid decision tree/genetic algorithm for data mining
    Carvalho, DR
    Freitas, AA
    [J]. APPLICATIONS AND SCIENCE IN SOFT COMPUTING, 2004, : 149 - 154
  • [8] Learning Algorithm of Decision Tree Generation for Continuous-valued Attribute
    Li Hua
    Hu Xiaojuan
    Sun Haizhen
    [J]. PROCEEDINGS OF THE 29TH CHINESE CONTROL CONFERENCE, 2010, : 2642 - 2644
  • [9] Decision Tree Generation Algorithm for Image-based Video Conferencing
    Sung, Yunsick
    Kwak, Jeonghoon
    Park, Jong Hyuk
    [J]. JOURNAL OF INTERNET TECHNOLOGY, 2019, 20 (05): : 1535 - 1545
  • [10] Decision-Making Tree Generation Algorithm for Weapon Resource Assignment
    Sui, Jiangbo
    Wu, Ling
    Xing, Changfeng
    [J]. PROCEEDINGS OF ANNUAL CONFERENCE OF CHINA INSTITUTE OF COMMUNICATIONS, 2010, : 40 - 43