An automatic document classifier system based on Naive Bayes Classifier and Ontology

An Automatic Document Classifier System based on Ontology and the Naive Bayes Classifier is proposed in this paper. The main concept is to first establish a keyword synonymous table by experts for narrowing down the range and getting the consistency of keywords. The Formal Concept Analysis is then used for establishing knowledge ontology through the complex categories and attributes relation. Finally, the ontology is applied to a Naive Bayes Classifier to get the automatic document classifier system. In this system, 319 documents divided into 11 categories are used to assess the effectiveness of classification, where 224 and 95 documents are the training and testing documents respectively, and the F1-measure is as the assessment criteria. The experimental results show that nine from 11 categories reaches 80% effectiveness of the documents classification, whereas the other two categories reached over 60% effectiveness of the documents classification. In sum, the average effectiveness of document classification in 11 categories is about 89%. Thus, the automatic classifier system can indeed reach the effectiveness of document classification.