Classifier ensembles for image identification using multi-objective Pareto features

被引:30
|
作者
Albukhanajer, Wissam A. [1 ]
Jin, Yaochu [2 ]
Briffa, Johann A. [3 ]
机构
[1] Univ Surrey, Fac Engn & Phys Sci, Surrey Space Ctr, Guildford GU2 7XH, Surrey, England
[2] Univ Surrey, Fac Engn & Phys Sci, Dept Comp Sci, Guildford GU2 7XH, Surrey, England
[3] Univ Malta, Fac Informat & Commun Technol, Dept Commun & Comp Engn, Msida 2080, Malta
基金
中国国家自然科学基金; 英国工程与自然科学研究理事会;
关键词
Pareto front; Classifier ensembles; Majority voting; Image identification; Trace transform; Evolutionary multi-objective optimization; TRACE TRANSFORM; RECOGNITION; DIVERSITY; ALGORITHM;
D O I
10.1016/j.neucom.2017.01.067
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper we propose classifier ensembles that use multiple Pareto image features for invariant image identification. Different from traditional ensembles that focus on enhancing diversity by generating diverse base classifiers, the proposed method takes advantage of the diversity inherent in the Pareto features extracted using a multi-objective evolutionary Trace transform algorithm. Two variants of the proposed approach have been implemented, one using multilayer perceptron neural networks as base classifiers and the other k-Nearest Neighbor. Empirical results on a large number of images from the Fish-94 and COIL-20 datasets show that on average, the proposed ensembles using multiple Pareto features perform much better than both, the traditional classifier ensembles of single Pareto features with data randomization, and the well-known Random Forest ensemble. The better classification performance of the proposed ensemble is further supported by diversity analysis using a number of measures, indicating that the proposed ensemble consistently produces a higher degree of diversity than traditional ones. Our experimental results demonstrate that the proposed classifier ensembles are robust to various geometric transformations in images such as rotation, scale and translation, and to additive noise. (C) 2017 Published by Elsevier B.V.
引用
收藏
页码:316 / 327
页数:12
相关论文
共 50 条
  • [1] MULTI-OBJECTIVE EVOLUTION OF THE PARETO OPTIMAL SET OF NEURAL NETWORK CLASSIFIER ENSEMBLES
    Engen, Vegard
    Vincent, Jonathan
    Schierz, Amanda C.
    Phalp, Keith
    [J]. PROCEEDINGS OF 2009 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-6, 2009, : 74 - 79
  • [2] Generating Diverse and Accurate Classifier Ensembles Using Multi-Objective Optimization
    Gu, Shenkai
    Jin, Yaochu
    [J]. 2014 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE IN MULTI-CRITERIA DECISION-MAKING (MCDM), 2014, : 9 - 15
  • [3] Exploring Multi-Objective Optimization for Multi-Label Classifier Ensembles
    Saha, Sriparna
    Sarkar, Debanjan
    Kramer, Stefan
    [J]. 2019 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2019, : 2753 - 2760
  • [4] Neural Network Ensembles For Image Identification Using Pareto-optimal Features
    Albukhanajer, Wissam A.
    Jin, Yaochu
    Briffa, Johann A.
    [J]. 2014 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2014, : 89 - 96
  • [5] Dynamic multi-objective evolution of classifier ensembles for video face recognition
    Connolly, Jean-Francois
    Granger, Eric
    Sabourin, Robert
    [J]. APPLIED SOFT COMPUTING, 2013, 13 (06) : 3149 - 3166
  • [6] MULTI-OBJECTIVE SBRT TREATMENT PLANNING USING PARETO
    Potrebko, P.
    Fiege, J.
    McCurdy, B.
    Champion, H.
    Cull, A.
    [J]. RADIOTHERAPY AND ONCOLOGY, 2011, 99 : S161 - S161
  • [7] Evolving Effective Ensembles for Image Classification Using Multi-objective Multi-tree Genetic Programming
    Fan, Qinglan
    Bi, Ying
    Xue, Bing
    Zhang, Mengjie
    [J]. AI 2022: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, 13728 : 294 - 307
  • [8] Multi-Objective Pareto Histogram Equalization
    Daumas-Ladouce, Federico
    Garcia-Torres, Miguel
    Noguera, Jose Luis Vazquez
    Pinto-Roa, Diego P.
    Legal-Ayala, Horacio
    [J]. ELECTRONIC NOTES IN THEORETICAL COMPUTER SCIENCE, 2020, 349 : 3 - 23
  • [9] Efficient Identification of a Multi-Objective Pareto Front on a Wireless Experimentation Facility
    Mehari, Michael Tetemke
    De Poorter, Eli
    Couckuyt, Ivo
    Deschrijver, Dirk
    Vermeeren, Gunter
    Plets, David
    Joseph, Wout
    Martens, Luc
    Dhaene, Tom
    Moerman, Ingrid
    [J]. IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2016, 15 (10) : 6662 - 6675
  • [10] Ensembles of multi-objective decision trees
    Kocev, Dragi
    Vens, Celine
    Struyf, Jan
    Dzeroski, Saso
    [J]. MACHINE LEARNING: ECML 2007, PROCEEDINGS, 2007, 4701 : 624 - +