A Novel Gender Classification Method based on MapReduce

被引:0
|
作者
Cui, Tong [1 ]
Zhao, Haifeng [1 ]
机构
[1] Sci & Technol Informat Syst Engn Lab, Nanjing, Jiangsu, Peoples R China
关键词
gender recognition; parallel meta-learning; MapReduce;
D O I
暂无
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
A novel parallelize gender recognition method with MapReduce is presented, which successfully comprise several machine leaning algorithms which are employed for gender recognition. The mass of face sample images are gathered and separated as train dataset and test dataset, and Local Binary Pattern (LBP) features are extracted when those sample sets are pre-processed and made ready for following operations. And Principle Component Analysis (PCA) is applied to train dataset to extract the most distinguishing features. Three classification algorithms: Support Vector Machine(SVM), k-Nearest Neighborhood (k-NN) and Adaboost are implemented and compared to determine the most suitable and successful algorithm for gender parallelize machine learning (GPML).To achieve the shortest execution time, we propose to apply GPML with MapReduce to avoid parallelizing above three algorithms while also improving their scalability to big datasets. The results show that this method reduces the training computational complexity significantly when the number of computing nodes increases while gaining better speedup rates and extending performance than those on parallelize Adaboost.
引用
收藏
页码:742 / 745
页数:4
相关论文
共 50 条
  • [41] A Novel Run-time Load Balancing Method for MapReduce
    Liu, Zhihong
    Liu, Yaping
    Wang, Baosheng
    Gong, Zhenghu
    [J]. PROCEEDINGS OF 2015 4TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT 2015), 2015, : 150 - 154
  • [42] Classification of Knowledge Processing by MapReduce
    Benhamed, Siham
    Nait-Bahloul, Safia
    [J]. 2014 4TH INTERNATIONAL SYMPOSIUM ISKO-MAGHREB: CONCEPTS AND TOOLS FOR KNOWLEDGE MANAGEMENT (ISKO-MAGHREB), 2014,
  • [43] A Novel MapReduce Based k-Means Clustering
    Sinha, Ankita
    Jana, Prasanta K.
    [J]. PROCEEDINGS OF THE FIRST INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND COMMUNICATION, 2017, 458 : 247 - 255
  • [44] A Density-based Anomaly Detection Method for MapReduce
    Wang, Kai
    Wang, Ying
    Yin, Bo
    [J]. 2012 11TH IEEE INTERNATIONAL SYMPOSIUM ON NETWORK COMPUTING AND APPLICATIONS (NCA), 2012, : 159 - 162
  • [45] MapReduce based computation of the diffusion method in recommender systems
    彭飞
    You Jiali
    Zeng Xuewen
    Deng Haojiang
    [J]. High Technology Letters, 2016, 22 (03) : 288 - 296
  • [46] MapReduce based computation of the diffusion method in recommender systems
    [J]. Peng, Fei (pengf@dsp.ac.cn), 1600, Inst. of Scientific and Technical Information of China (22):
  • [47] MapReduce based Method for Big Data Semantic Clustering
    Yang, Jie
    Li, Xiaoping
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2013), 2013, : 2814 - 2819
  • [48] A Fusion-based Method for 3D Facial Gender Classification
    Hu, Yuan
    Yan, Jingqi
    Shi, Pengfei
    [J]. 2010 2ND INTERNATIONAL CONFERENCE ON COMPUTER AND AUTOMATION ENGINEERING (ICCAE 2010), VOL 5, 2010, : 369 - 372
  • [49] A novel gray-based reduced NN classification method
    Huang, Chi-Chun
    [J]. PATTERN RECOGNITION, 2006, 39 (11) : 1979 - 1986
  • [50] A Novel Classification Method Based on Stacking Ensemble for Imbalanced Problems
    Wang, Zengshuai
    Zheng, Minhua
    Liu, Peter Xiaoping
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72