A parallel metaheuristic data clustering framework for cloud

被引:19
|
作者
Tsai, Chun-Wei [1 ]
Liu, Shi-Jui
Wang, Yi-Chung
机构
[1] Natl Chung Hsing Univ, Dept Comp Sci & Engn, Taichung, Taiwan
关键词
Metaheuristic algorithm; Internet of things; Data clustering problem; GENETIC ALGORITHM; INTERNET; THINGS; SPARK; SERVICES; FUSION;
D O I
10.1016/j.jpdc.2017.10.020
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
A high performance data analytics for internet of things (IoT) has been a promising research subject in recent years because traditional data mining algorithms may not be applicable to big data of IoT. One of the main reasons is that the data that need to be analyzed may exceed the storage size of a single machine. The computation cost of data analysis tasks that is too high for a single computer system is another critical problem we have to confront when analyzing data from an IoT system. That is why an efficient data clustering framework for metaheuristic algorithm on a cloud computing environment is presented in this paper for data analytics, which explains how to divide mining tasks of a mining algorithm into different nodes (i.e., the Map process) and then aggregate the mining results from these nodes (i.e., Reduce process). We further attempted to use the proposed framework to implement data clustering algorithms (e.g., k-means, genetic k-means, and particle swarm optimization) on a standalone system and Spark. The experimental results show that the performance of the proposed framework makes it useful to develop data clustering algorithms on a cloud computing environment. (C) 2017 Elsevier Inc. All rights reserved.
引用
收藏
页码:39 / 49
页数:11
相关论文
共 50 条
  • [21] A Clustering System for Dynamic Data Streams Based on Metaheuristic Optimisation
    Yeoh, Jia Ming
    Caraffini, Fabio
    Homapour, Elmina
    Santucci, Valentino
    Milani, Alfredo
    MATHEMATICS, 2019, 7 (12)
  • [22] Efficient and Parallel Data Processing and Resource Allocation in the Cloud by using Nephele's Data Processing Framework
    Saranya, V.
    Ramya, S.
    Kumar, R. G. Suresh
    Nalini, T.
    INTERNATIONAL JOURNAL OF GRID AND DISTRIBUTED COMPUTING, 2016, 9 (03): : 33 - 40
  • [23] Implementing Parallel Metaheuristic Optimization Framework Using Metaprogramming and Design Patterns
    Tsyganov, Andrey V.
    Bulychov, Oleg I.
    INFORMATION TECHNOLOGY APPLICATIONS IN INDUSTRY, PTS 1-4, 2013, 263-266 : 1864 - +
  • [24] A Novel Parallel Framework for Metaheuristic-based Frequent Itemset Mining
    Djenouri, Youcef
    Djenouri, Djamel
    Belhadi, Asma
    Lin, Jerry Chun-Wei
    Bendjoudi, Ahcene
    Fournier-Viger, Philippe
    2019 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2019, : 1439 - 1445
  • [25] A Parallel Secure Flow Control Framework for Private Data Sharing in Mobile Edge Cloud
    Huang, Qinlong
    Chen, Lixuan
    Wang, Chao
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (12) : 4638 - 4653
  • [26] A methodological framework for cloud resource provisioning and scheduling of data parallel applications under uncertainty
    Calzarossa, Maria Carla
    Della Vedova, Marco L.
    Tessera, Daniele
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2019, 93 : 212 - 223
  • [27] Highly Distributable Associative Memory Based Computational Framework for Parallel Data Processing in Cloud
    Basirat, Amir Hossein
    Khan, Asad I.
    Srinivasan, Balasubramaniam
    MOBILE AND UBIQUITOUS SYSTEMS: COMPUTING, NETWORKING, AND SERVICES, 2014, 131 : 66 - 77
  • [28] Jobcast - Parallel and distributed processing framework Data processing on a cloud style KVS database
    Nakagawa, Ikuo
    Nagami, Kenichi
    2012 IEEE/IPSJ 12TH INTERNATIONAL SYMPOSIUM ON APPLICATIONS AND THE INTERNET (SAINT), 2012, : 123 - 128
  • [29] Parallel Version of the Framework for Clustering Error Messages
    M. Vorobyov
    K. Zhukov
    M. Grigorieva
    S. Korobkov
    Lobachevskii Journal of Mathematics, 2021, 42 : 1596 - 1607
  • [30] Parallel Version of the Framework for Clustering Error Messages
    Vorobyov, M.
    Zhukov, K.
    Grigorieva, M.
    Korobkov, S.
    LOBACHEVSKII JOURNAL OF MATHEMATICS, 2021, 42 (07) : 1596 - 1607