A Novel Gender Classification Method based on MapReduce

被引:0
|
作者
Cui, Tong [1 ]
Zhao, Haifeng [1 ]
机构
[1] Sci & Technol Informat Syst Engn Lab, Nanjing, Jiangsu, Peoples R China
关键词
gender recognition; parallel meta-learning; MapReduce;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
A novel parallelize gender recognition method with MapReduce is presented, which successfully comprise several machine leaning algorithms which are employed for gender recognition. The mass of face sample images are gathered and separated as train dataset and test dataset, and Local Binary Pattern (LBP) features are extracted when those sample sets are pre-processed and made ready for following operations. And Principle Component Analysis (PCA) is applied to train dataset to extract the most distinguishing features. Three classification algorithms: Support Vector Machine(SVM), k-Nearest Neighborhood (k-NN) and Adaboost are implemented and compared to determine the most suitable and successful algorithm for gender parallelize machine learning (GPML).To achieve the shortest execution time, we propose to apply GPML with MapReduce to avoid parallelizing above three algorithms while also improving their scalability to big datasets. The results show that this method reduces the training computational complexity significantly when the number of computing nodes increases while gaining better speedup rates and extending performance than those on parallelize Adaboost.
引用
收藏
页码:742 / 745
页数:4
相关论文
共 50 条
  • [1] A MapReduce based approach for classification
    Haldankar, Akash
    Bhowmick, Kiran
    [J]. PROCEEDINGS OF 2016 ONLINE INTERNATIONAL CONFERENCE ON GREEN ENGINEERING AND TECHNOLOGIES (IC-GET), 2016,
  • [2] MapReduce based for speech classification
    Quang Trung Nguyen
    The Duy Bui
    [J]. PROCEEDINGS OF THE SEVENTH SYMPOSIUM ON INFORMATION AND COMMUNICATION TECHNOLOGY (SOICT 2016), 2016, : 87 - 91
  • [3] A NOVEL FUSION-BASED METHOD FOR EXPRESSION-INVARIANT GENDER CLASSIFICATION
    Lu, Li
    Shi, Pengfei
    [J]. 2009 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS 1- 8, PROCEEDINGS, 2009, : 1065 - 1068
  • [4] An Improved Classification Course Based on Mapreduce
    Wang, Haitao
    Liu, Shufeng
    Jia, Zongpu
    [J]. INTERNATIONAL JOURNAL OF GRID AND DISTRIBUTED COMPUTING, 2015, 8 (03): : 43 - 52
  • [5] A Novel Configuration Tuning Method Based on Feature Selection for Hadoop MapReduce
    Liu, Jun
    Tang, Sule
    Xu, Guangxia
    Ma, Chuang
    Lin, Mingwei
    [J]. IEEE ACCESS, 2020, 8 : 63862 - 63871
  • [6] A novel method based on MapReduce to extract auxiliary information for GNSS receivers
    Li, Dengao
    Wu, Gang
    Zhao, Jumin
    Niu, Wenhui
    Li, Shuai
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2017, 29 (06):
  • [7] A novel classification method based on hypersurface
    He, Q
    Shi, ZZ
    Ren, LA
    Lee, ES
    [J]. MATHEMATICAL AND COMPUTER MODELLING, 2003, 38 (3-4) : 395 - 407
  • [8] Parallel Implementation of Classification Algorithms Based on MapReduce
    He, Qing
    Zhuang, Fuzhen
    Li, Jincheng
    Shi, Zhongzhi
    [J]. ROUGH SET AND KNOWLEDGE TECHNOLOGY (RSKT), 2010, 6401 : 655 - 662
  • [9] A Novel J wave Detection Method Based on Massive ECG Data and MapReduce
    Li, Dengao
    Ma, Wei
    Zhao, Jumin
    [J]. BIG DATA COMPUTING AND COMMUNICATIONS, (BIGCOM 2016), 2016, 9784 : 399 - 408
  • [10] A novel conception based texts classification method
    Bai Rujiang
    Liao Junhua
    [J]. AST: 2009 INTERNATIONAL E-CONFERENCE ON ADVANCED SCIENCE AND TECHNOLOGY, PROCEEDINGS, 2009, : 30 - 34