RoughTree: A classifier with Naive-Bayes and rough sets hybrid in decision tree representation

This paper presents a semi-naive classifier named RoughTree, which is designed to alleviate the attribute interdependence problem of Naive Bayesian Classifier. RoughTree uses the attribute dependence detecting measure in Rough Sets and splits the dataset into subspaces according to the selected attributes, which hold the maximum values by the attribute dependence measure. This process continues the same way a decision tree splits until the stopping criterion is satisfied. Then, the result is a tree-like model and each leaf in the RoughTree is replaced by a Naive-Bayesian classifier. RoughTree eliminates the attribute dependences in its leaves and the experimental results show that RoughTree can achieve better performance than Naive Bayesian classifier.