On Greedy Algorithms for Decision Trees

被引:0
|
作者
Cicalese, Ferdinando [1 ]
Jacobs, Tobias [2 ]
Laber, Eduardo [3 ]
Molinaro, Marco [4 ]
机构
[1] Univ Salerno, Salerno, Italy
[2] Natl Inst Informat, Tokyo, Japan
[3] PUC, Rio De Janeiro, Brazil
[4] Carnegie Mellon Univ, Pittsburgh, PA USA
来源
关键词
COST;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In the general search problem we want to identify a specific element using a set of allowed tests. The general goal is to minimize the number of tests performed, although different measures are used to capture this goal. In this work we introduce a novel greedy approach that achieves the best known approximation ratios simultaneously for many different variations of this identification problem. In addition to this flexibility, our algorithm admits much shorter and simpler analyses than previous greedy strategies. As a second contribution, we investigate the potential of greedy algorithms for the more restricted problem of identifying elements of partially ordered sets by comparison with other elements. We prove that the latter problem is as hard to approximate as the general identification problem. As a positive result, we show that a natural greedy strategy achieves an approximation ratio of 2 for tree-like posets, improving upon the previously best known 14-approximation for this problem.
引用
收藏
页码:206 / +
页数:3
相关论文
共 50 条
  • [1] COMPARISON OF GREEDY ALGORITHMS FOR DECISION TREE CONSTRUCTION
    Alkhalid, Abdulaziz
    Chikalov, Igor
    Moshkov, Mikhail
    [J]. KDIR 2011: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND INFORMATION RETRIEVAL, 2011, : 438 - 443
  • [2] Comparison of Greedy Algorithms for α-Decision Tree Construction
    Alkhalid, Abdulaziz
    Chikalov, Igor
    Moshkov, Mikhail
    [J]. ROUGH SETS AND KNOWLEDGE TECHNOLOGY, 2011, 6954 : 178 - 186
  • [3] Efficient Non-greedy Optimization of Decision Trees
    Norouzi, Mohammad
    Collins, Maxwell D.
    Johnson, Matthew
    Fleet, David J.
    Kohli, Pushmeet
    [J]. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 28 (NIPS 2015), 2015, 28
  • [4] Algorithms for constructing of decision trees
    Moshkov, M
    [J]. PRINCIPLES OF DATA MINING AND KNOWLEDGE DISCOVERY, 1997, 1263 : 335 - 342
  • [5] Greedy Algorithms for Sparse Adaptive Decision Feedback Equalization
    Lalos, Aris S.
    Vlachos, Evangelos
    Berberidis, Kostas
    Rontogiannis, Athanasios A.
    [J]. 2011 IEEE INTERNATIONAL SYMPOSIUM ON SIGNAL PROCESSING AND INFORMATION TECHNOLOGY (ISSPIT), 2011, : 240 - 245
  • [6] Greedy Heuristics for Minimization of Number of Terminal Nodes in Decision Trees
    Hussain, Shahid
    [J]. 2014 IEEE INTERNATIONAL CONFERENCE ON GRANULAR COMPUTING (GRC), 2014, : 112 - 115
  • [7] Algorithms for optimal dyadic decision trees
    Hush, Don
    Porter, Reid
    [J]. MACHINE LEARNING, 2010, 80 (01) : 85 - 107
  • [8] Algorithms for optimal dyadic decision trees
    Don Hush
    Reid Porter
    [J]. Machine Learning, 2010, 80 : 85 - 107
  • [9] Missing value algorithms in decision trees
    Kim, H
    Yates, S
    [J]. STATISTICAL DATA MINING AND KNOWLEDGE DISCOVERY, 2004, : 155 - 172
  • [10] Entropy-Based Greedy Algorithm for Decision Trees Using Hypotheses
    Azad, Mohammad
    Chikalov, Igor
    Hussain, Shahid
    Moshkov, Mikhail
    [J]. ENTROPY, 2021, 23 (07)