Inducing Hierarchical Multi-label Classification rules with Genetic Algorithms

被引:14
|
作者
Cerri, Ricardo [1 ]
Basgalupp, Marcio P. [2 ]
Barros, Rodrigo C. [3 ]
de Carvalho, Andre C. P. L. F. [4 ]
机构
[1] Univ Fed Sao Carlos, Dept Comp Sci, Sao Carlos, SP, Brazil
[2] Univ Fed Sao Paulo, Inst Ciencia & Tecnol, Sao Paulo, SP, Brazil
[3] Pontificia Univ Catolica Rio Grande do Sul, Sch Technol, Porto Alegre, RS, Brazil
[4] Univ Sao Paulo, Inst Ciencias Matemat & Comp, Sao Paulo, Brazil
基金
巴西圣保罗研究基金会;
关键词
Hierarchical Multi-label Classification; Protein function prediction; Machine learning; Genetic Algorithms; Rule induction; EXPRESSION; CLASSIFIERS; ENSEMBLES; DATABASE;
D O I
10.1016/j.asoc.2019.01.017
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hierarchical Multi-Label Classification is a challenging classification task where the classes are hierarchically structured, with superclass and subclass relationships. It is a very common task, for instance, in Protein Function Prediction, where a protein can simultaneously perform multiple functions. In these tasks it is very difficult to achieve a high predictive performance, since hundreds or even thousands of classes with imbalanced data distributions have to be considered. In addition, the models should ideally be easily interpretable to allow the validation of the knowledge extracted from the data. This work proposes and investigates the use of Genetic Algorithms to induce rules that are both hierarchical and multi-label. Several experiments with different fitness functions and genetic operators are preformed to obtain different Hierarchical Multi-Label Classification rules. The different proposed configurations of Genetic Algorithms are evaluated together with state-of-the-art methods for HMC rule induction based on Ant Colony Optimization and Predictive Clustering Trees, using many datasets related to the Protein Function Prediction task. The experimental results show that it is possible to recommend the best configuration in terms of predictive performance and model interpretability. (C) 2019 Elsevier B.V. All rights reserved.
引用
下载
收藏
页码:584 / 604
页数:21
相关论文
共 50 条
  • [1] A Survey of Genetic Algorithms for Multi-Label Classification
    Goncalves, Eduardo Correa
    Freitas, Alex A.
    Plastino, Alexandre
    2018 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2018, : 981 - 988
  • [2] A Grammatical Evolution Algorithm for Generation of Hierarchical Multi-Label Classification Rules
    Cerri, Ricardo
    Barros, Rodrigo C.
    de Carvalho, Andre C. P. L. F.
    Freitas, Alex A.
    2013 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2013, : 454 - 461
  • [3] Hierarchical Multi-label Associative Classification (HMAC) using negative rules
    Computer Engineering Department, Faculty of Engineering, Kasetsart University, Thailand
    不详
    Proc. IEEE Int. Conf. Cognitive Informatics, ICCI, (919-924):
  • [4] ReliefF for Hierarchical Multi-label Classification
    Slavkov, Ivica
    Karcheska, Jana
    Kocev, Dragi
    Kalajdziski, Slobodan
    Dzeroski, Saso
    NEW FRONTIERS IN MINING COMPLEX PATTERNS, NFMCP 2013, 2014, 8399 : 148 - 161
  • [5] Hierarchical Multi-Label Classification Networks
    Wehrmann, Jonatas
    Cerri, Ricardo
    Barros, Rodrigo C.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [6] The importance of the label hierarchy in hierarchical multi-label classification
    Jurica Levatić
    Dragi Kocev
    Sašo Džeroski
    Journal of Intelligent Information Systems, 2015, 45 : 247 - 271
  • [7] The importance of the label hierarchy in hierarchical multi-label classification
    Levatic, Jurica
    Kocev, Dragi
    Dzeroski, Saso
    JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2015, 45 (02) : 247 - 271
  • [8] Label Correction Strategy on Hierarchical Multi-Label Classification
    Ananpiriyakul, Thanawut
    Poomsirivilai, Piyapan
    Vateekul, Peerapon
    MACHINE LEARNING AND DATA MINING IN PATTERN RECOGNITION, MLDM 2014, 2014, 8556 : 213 - 227
  • [9] Exploiting Anti-monotonicity of Multi-label Evaluation Measures for Inducing Multi-label Rules
    Rapp, Michael
    Mencia, Eneldo Loza
    Fuernkranz, Johannes
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2018, PT I, 2018, 10937 : 29 - 42
  • [10] Active learning for hierarchical multi-label classification
    Nakano, Felipe Kenji
    Cerri, Ricardo
    Vens, Celine
    DATA MINING AND KNOWLEDGE DISCOVERY, 2020, 34 (05) : 1496 - 1530