Research on Parallelization of Logsf Feature Selection Algorithm

被引:0
|
作者
Guo, Aizhang [1 ]
Zhang, Ningning [1 ]
Sun, Tao [1 ]
机构
[1] Qilu Univ Technol, Sch Informat, Tinan, Peoples R China
来源
PROCEEDINGS OF 2018 IEEE 3RD ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC 2018) | 2018年
关键词
Hadoop; feature selection; local learning; Logsf algorithm; MapReduce; EIGENFACES;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the advent of the large data age, it is becoming more and more important to reduce the dimension of data. As a common means of data reduction preprocessing, feature selection has attracted more and more attention in recent years. At present, it is mainly based on the traditional feature selection algorithm, but the traditional method has been unable to meet the requirements of massive high-dimensional data processing. So, this paper studies the Logsf feature selection algorithm based on local learning, and improves the shortcomings of the existing algorithm. Then, by using the Mapreduce framework in the Hadoop platform, the improved Logsf feature selection algorithm is designed and implemented in parallel. Finally, the experimental results show that the improved Logsf feature selection algorithm for parallel processing is superior to the existing Logsf feature selection algorithm in the accuracy and the speedup. It fully shows that the characteristics of the parallel Logsf algorithm has a good reliability in this paper.
引用
收藏
页码:2143 / 2147
页数:5
相关论文
共 50 条
  • [21] Research on the algorithm of feature selection based on Gini index for text categorization
    Shang, Wenqian
    Huang, Houkuan
    Liu, Yuling
    Lin, Yongmin
    Qu, Youli
    Dong, Hongbin
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2006, 43 (10): : 1688 - 1694
  • [22] Structured Multi-view Supervised Feature Selection Algorithm Research
    Shi, Caijuan
    Zhao, Li-Li
    Liu, Liping
    Liu, Jian
    Tian, Qi
    COMPUTER VISION, PT II, 2017, 772 : 149 - 157
  • [23] Research on Feature Selection and Classification Algorithm of Medical Optical Tomography Images
    Ji, Hongkun
    Guo, Kaiwen
    Yang, Lizhu
    Jiang, Weinan
    Zhao, Zijun
    Zhu, Xukang
    Hou, Alin
    2019 IEEE/CIC INTERNATIONAL CONFERENCE ON COMMUNICATIONS IN CHINA (ICCC), 2019,
  • [24] Research on the ensemble feature selection algorithm based on multimodal optimisation techniques
    Wang, Yan-li
    Qu, Bo-yang
    Liang, Jing
    Hu, Yi
    Wei, Yun-peng
    INTERNATIONAL JOURNAL OF BIO-INSPIRED COMPUTATION, 2021, 18 (01) : 49 - 58
  • [25] Research of multi-population agent genetic algorithm for feature selection
    Li, Yongming
    Zhang, Sujuan
    Zeng, Xiaoping
    EXPERT SYSTEMS WITH APPLICATIONS, 2009, 36 (09) : 11570 - 11581
  • [26] Research on DFF-TopK algorithm based on dynamic feature selection
    Zhou, Xingyi
    Xu, Guoyan
    Liu, Fan
    Su, Xinyue
    14TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND EDUCATION (ICCSE 2019), 2019, : 493 - 498
  • [27] Research on Feature Selection and Classification Recognition Algorithm of Cervical Cell Image
    Dong N.
    Zhao L.
    Chang J.
    Wu A.
    Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2019, 46 (12): : 1 - 8
  • [28] The Research Of Feature Selection Of Text Classification Based On Integrated Learning Algorithm
    Xia Huosong
    Liu Jian
    2011 TENTH INTERNATIONAL SYMPOSIUM ON DISTRIBUTED COMPUTING AND APPLICATIONS TO BUSINESS, ENGINEERING AND SCIENCE (DCABES), 2011, : 20 - 22
  • [29] A Hybrid Feature Selection Algorithm
    Yin, Chunyong
    Ma, Luyu
    Feng, Lu
    Wang, Jin
    Yin, Zhichao
    Kim, Jeong-Uk
    2015 4TH INTERNATIONAL CONFERENCE ON ADVANCED INFORMATION TECHNOLOGY AND SENSOR APPLICATION (AITS), 2015, : 104 - 107
  • [30] A Feature Selection Algorithm for IDS
    Gul, Ayse
    Adali, Esref
    2017 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ENGINEERING (UBMK), 2017, : 816 - 820