Epilepsy is one of the most common neurological diseases, affecting approximately 50 million people. This illness can be diagnosed by electroencephalogram (EEG), whose analysis depends on human interpretation, which may lead to divergent results and be imprecise and error-prone. Moreover, one estimates more than 80% of the epilepsy examinations return no anomalies at all, wasting the effort of analysis. In this context, machine learning (ML) methods are used to aid in epilepsy detection. An essential task for classifier building is feature extraction, for which there are many measures that can be computed. However, part of these features can be irrelevant or hinder the performance of ML methods. This paper proposes an automatic way to classify EEG segments by using a reduced set of features. The proposed method combines multispectral analysis, feature selection, and classifier building approaches. As our main contribution, a methodology to minimize the number of features for classifier building is proposed. A total of 285 measures are extracted. Afterward, two attribute selection approaches are used: Pearson’s correlation coefficient filter and wrapper based on the genetic algorithm. Then, five well-known ML methods (k-nearest-neighbor, support vector machine, naive Bayes, artificial neural network, and random forest) were used to build 281 different classifiers. As a result, the proposed classifiers reached an accuracy between 87.2 and 90.99% and considerably reduced the number of features from 285 to 30, keeping competitive scores. Additionally, statistical hypothesis tests prove that our proposed approach is as efficient as using the complete feature dataset for classifier building.