Feature Selection Based on Semantics

The need for an automated text categorization system is spurred on by the extensive increase of digital documents. This paper looks into feature selection, one of the main processes in text categorization. The feature selection approach is based on semantics by employing WordNet [1]. The proposed WordNet-based feature selection approach makes use of synonymous nouns and dominant senses in selecting terms that are reflective of a category's content. Experiments are carried out using the top ten most populated categories of the Reuters-21578 dataset. Results have shown that statistical feature selection approaches, Chi-Square and Information Gain, are able to produce better results when used with the WordNet-basecl feature selection approach. The use of the WordNet-based feature selection approach with statistical weighting results in it set of terms that is more meaningful compared to the terms chosen by the statistical approaches. In addition, there is also nit effective dimensionality reduction of the feature space when the WordNet-based feature selection method is used.