A parallel metaheuristic data clustering framework for cloud

被引:19
|
作者
Tsai, Chun-Wei [1 ]
Liu, Shi-Jui
Wang, Yi-Chung
机构
[1] Natl Chung Hsing Univ, Dept Comp Sci & Engn, Taichung, Taiwan
关键词
Metaheuristic algorithm; Internet of things; Data clustering problem; GENETIC ALGORITHM; INTERNET; THINGS; SPARK; SERVICES; FUSION;
D O I
10.1016/j.jpdc.2017.10.020
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
A high performance data analytics for internet of things (IoT) has been a promising research subject in recent years because traditional data mining algorithms may not be applicable to big data of IoT. One of the main reasons is that the data that need to be analyzed may exceed the storage size of a single machine. The computation cost of data analysis tasks that is too high for a single computer system is another critical problem we have to confront when analyzing data from an IoT system. That is why an efficient data clustering framework for metaheuristic algorithm on a cloud computing environment is presented in this paper for data analytics, which explains how to divide mining tasks of a mining algorithm into different nodes (i.e., the Map process) and then aggregate the mining results from these nodes (i.e., Reduce process). We further attempted to use the proposed framework to implement data clustering algorithms (e.g., k-means, genetic k-means, and particle swarm optimization) on a standalone system and Spark. The experimental results show that the performance of the proposed framework makes it useful to develop data clustering algorithms on a cloud computing environment. (C) 2017 Elsevier Inc. All rights reserved.
引用
收藏
页码:39 / 49
页数:11
相关论文
共 50 条
  • [1] A supervised parallel optimisation framework for metaheuristic algorithms
    Muttio, Eugenio J.
    Dettmer, Wulf G.
    Clarke, Jac
    Peric, Djordje
    Ren, Zhaoxin
    Fletcher, Lloyd
    SWARM AND EVOLUTIONARY COMPUTATION, 2024, 84
  • [2] Parallel and distributed clustering framework for big spatial data mining
    Bendechache, Malika
    Tari, A-Kamel
    Kechadi, M-Tahar
    INTERNATIONAL JOURNAL OF PARALLEL EMERGENT AND DISTRIBUTED SYSTEMS, 2019, 34 (06) : 671 - 689
  • [3] A Metaheuristic Framework for Dynamic Virtual Machine Allocation With Optimized Task Scheduling in Cloud Data Centers
    Alsadie, Deafallah
    IEEE ACCESS, 2021, 9 : 74218 - 74233
  • [4] PPPCT: Privacy-Preserving framework for Parallel Clustering Transcriptomics data
    Tadi A.A.
    Alhadidi D.
    Rueda L.
    Computers in Biology and Medicine, 2024, 173
  • [5] An Efficient Parallel Algorithm for Clustering Big Data based on the Spark Framework
    Faculty of Science of Rabat, Mohammed V University, Rabat, Morocco
    Intl. J. Adv. Comput. Sci. Appl., 7 (890-896):
  • [6] An Efficient Parallel Algorithm for Clustering Big Data based on the Spark Framework
    Dafir, Zineb
    Slaoui, Said
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2022, 13 (07) : 890 - 896
  • [7] GPS: A General Framework for Parallel Queries over Data Streams in Cloud
    Li, Xiaoyong
    Wang, Yijie
    Zhao, Yue
    Wang, Yuan
    Li, Xiaoling
    2013 IEEE 15TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS & 2013 IEEE INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING (HPCC_EUC), 2013, : 1139 - 1146
  • [8] PRIMEBALL: A Parallel Processing Framework Benchmark for Big Data Applications in the Cloud
    Ferrarons, Jaume
    Adhana, Mulu
    Colmenares, Carlos
    Pietrowska, Sandra
    Bentayeb, Fadila
    Darmont, Jerome
    PERFORMANCE CHARACTERIZATION AND BENCHMARKING, 2014, 8391 : 109 - 124
  • [9] Bio-inspired metaheuristic framework for clustering optimisation in VANETs
    Alsuhli, Ghada H.
    Fahmy, Yasmine A.
    Khattab, Ahmed
    IET INTELLIGENT TRANSPORT SYSTEMS, 2020, 14 (10) : 1190 - 1199
  • [10] An efficient clustering scheme for cloud computing problems using metaheuristic algorithms
    Baalamurugan, K. M.
    Bhanu, S. Vijay
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (Suppl 5): : 12917 - 12927