Multiobjective Evolutionary Optimization of Type-2 Fuzzy Rule-Based Systems for Financial Data Classification

被引:80
|
作者
Antonelli, Michela [1 ,2 ]
Bernardo, Dario [3 ]
Hagras, Hani
Marcelloni, Francesco [1 ]
机构
[1] Univ Pisa, Dipartimento Ingn Informaz, I-56100 Pisa, Italy
[2] UCL, Ctr Med Image Comp, London WC1E 6BT, England
[3] Univ Essex, Sch Comp Sci & Elect Engn, Computat Intelligence Ctr, Colchester CO4 3SQ, Essex, England
关键词
Financial datasets; multiobjective evolutionary fuzzy systems; type-2 fuzzy rule-based classifiers; unbalanced datasets; GENETIC ALGORITHMS; INTERPRETABILITY; SELECTION; IDENTIFICATION; CLASSIFIERS; CONTROLLER; DESIGN; FURIA;
D O I
10.1109/TFUZZ.2016.2578341
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Classification techniques are becoming essential in the financial world for reducing risks and possible disasters. Managers are interested in not only high accuracy, but in interpretability and transparency as well. It is widely accepted now that the comprehension of how inputs and outputs are related to each other is crucial for taking operative and strategic decisions. Furthermore, inputs are often affected by contextual factors and characterized by a high level of uncertainty. In addition, financial data are usually highly skewed toward themajority class. With the aim of achieving high accuracies, preserving the interpretability, and managing uncertain and unbalanced data, this paper presents a novel method to deal with financial data classification by adopting type-2 fuzzy rule-based classifiers (FRBCs) generated from data by a multi-objective evolutionary algorithm (MOEA). The classifiers employ an approach, denoted as scaled dominance, for defining rule weights in such away to help minority classes to be correctly classified. In particular, we have extended PAES-RCS, an MOEA-based approach to learn concurrently the rule and data bases of FRBCs, for managing both interval type-2 fuzzy sets and unbalanced datasets. To the best of our knowledge, this is the first work that generates type-2 FRBCs by concurrently maximizing accuracy and minimizing the number of rules and the rule length with the objective of producing interpretable models of real-world skewed and incomplete financial datasets. The rule bases are generated by exploiting a rule and condition selection (RCS) approach, which selects a reduced number of rules from a heuristically generated rule base and a reduced number of conditions for each selected rule during the evolutionary process. The weight associated with each rule is scaled by the scaled dominance approach on the fuzzy frequency of the output class, in order to give a higher weight to the minority class. As regards the data base learning, the membership function parameters of the interval type-2 fuzzy sets used in the rules are learned concurrently to the application of RCS. Unbalanced datasets are managed by using, in addition to complexity, selectivity and specificity as objectives of the MOEA rather than only the classification rate. We tested our approach, named IT2-PAES-RCS, on 11 financial datasets and compared our results with the ones obtained by the original PAES-RCS with three objectives and with and without scaled dominance, the FRBCs, fuzzy association rule-based classification model for high-dimensional dataset (FARC-HD) and fuzzy unordered rules induction algorithm (FURIA), the classical C4.5 decision tree algorithm, and its cost-sensitive version. Using nonparametric statistical tests, we will show that IT2-PAES-RCS generates FRBCs with, on average, accuracy statistically comparable with and complexity lower than the ones generated by the two versions of the original PAES-RCS. Further, the FRBCs generated by FARC-HD and FURIA and the decision trees computed by C4.5 and its cost-sensitive version, despite the highest complexity, result to be less accurate than the FRBCs generated by IT2-PAES-RCS. Finally, we will highlight how these FRBCs are easily interpretable by showing and discussing one of them.
引用
收藏
页码:249 / 264
页数:16
相关论文
共 50 条
  • [41] A Fuzzy Rule-Based Penalty Function Approach for Constrained Evolutionary Optimization
    Saha, Chiranjib
    Das, Swagatam
    Pal, Kunal
    Mukherjee, Satrajit
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2016, 46 (12) : 2953 - 2965
  • [42] Interpretable Fuzzy Rule-based Systems for Classification of Multi-Class EEG Data
    Zareian, Elham
    Chen, Jun
    O'Hare, Louise
    Sen Bhattacharya, Basabdatta
    Gordon, Timothy
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2018, : 4218 - 4223
  • [43] Type-2 fuzzy rule-based expert system for diagnosis of spinal cord disorders
    Damirchi-Darasi, S. Rahimi
    Zarandi, M. H. Fazel
    Turksen, I. B.
    Izadi, M.
    [J]. SCIENTIA IRANICA, 2019, 26 (01) : 455 - 471
  • [44] APPLICATION OF TYPE-2 FUZZY LOGIC TO RULE-BASED INTRUSION ALERT CORRELATION DETECTION
    Huang, Chenn-Jung
    Hu, Kai-Wen
    Chen, Heng-Ming
    Chang, Tao-Ku
    Luo, Yun-Cheng
    Lien, Yih-Jhe
    [J]. INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2012, 8 (04): : 2865 - 2874
  • [45] A type-2 fuzzy rule-based expert system model for stock price analysis
    Zarandi, M. H. Fazel
    Rezaee, B.
    Turksen, I. B.
    Neshat, E.
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2009, 36 (01) : 139 - 154
  • [46] A proposal on reasoning methods in fuzzy rule-based classification systems
    Cordón, O
    del Jesus, MJ
    Herrera, F
    [J]. INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 1999, 20 (01) : 21 - 45
  • [47] Voting in fuzzy rule-based systems for pattern classification problems
    Ishibuchi, H
    Nakashima, T
    Morisawa, T
    [J]. FUZZY SETS AND SYSTEMS, 1999, 103 (02) : 223 - 238
  • [48] An Evolutionary Optimization based Interval Type-2 Fuzzy Classification System for Human Behaviour Recognition and Summarisation
    Yao, Bo
    Hagras, Hani
    Lepley, Jason J.
    Peall, Robert
    Butler, Michael
    [J]. 2016 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2016, : 4706 - 4711
  • [49] Interval type-2 fuzzy rule mining algorithm based on multi-population quantum evolutionary optimization
    Qian, Xiao-Yi
    Zhang, Yu-Xian
    Zhang, Zhi-Feng
    Wang, Jian-Hui
    [J]. Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2019, 36 (01): : 32 - 42
  • [50] Support vector learning for fuzzy rule-based classification systems
    Chen, YX
    Wang, JZ
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2003, 11 (06) : 716 - 728