A Task Scheduling Policy for Heterogeneous MapReduce Cluster

被引：0

作者：

Chiu, Chui-Ming ^{[1
]}

Huang, Sheng-Wei ^{[1
]}

Huang, Tzu-Chi ^{[2
]}

Shieh, Ce-Kuen ^{[1
]}

Tsai, Ming-Fong ^{[3
]}

Chen, Lien-Wu ^{[3
]}

机构：

[1] Natl Cheng Kung Univ, Dept Elect Engn, Inst Comp & Commun Engn, Tainan, Taiwan

[2] Lunghwa Univ Sci & Technol, Dept Elect Engn, Taoyuan, Taiwan

[3] Feng Chia Univ, Dept Informat Engn & Comp Sci, Taichung, Taiwan

来源：

INTELLIGENT SYSTEMS AND APPLICATIONS (ICS 2014) | 2015年 / 274卷

关键词：

MapReduce; Distributed Computing; Cooperative Cluster; Heterogeneous Environment; Big Data;

D O I：

10.3233/978-1-61499-484-8-420

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

MapReduce is a programming model and its associated run-time system proposed in 2004, which can process large scale of data in clusters with simple program logic. MapReduce has a potential problem running on a cooperative cluster which is combined with machines having different configurations. The problem will cause unexpected performance degradations and should be avoided. In this paper, a task scheduling policy is proposed to take higher utilization of all computing nodes in heterogeneous clusters.

引用

页码：420 / 429

页数：10

共 50 条

[1] Task scheduling for MapReduce in heterogeneous networks
Wang, Jia
Li, Xiaoping
[J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2016, 19 (01): : 197 - 210
[2] Task scheduling for MapReduce in heterogeneous networks
Jia Wang
Xiaoping Li
[J]. Cluster Computing, 2016, 19 : 197 - 210
[3] Task Scheduling for MapReduce Based on Heterogeneous Networks
Wang, Jia
Li, Xiaoping
[J]. HUMAN CENTERED COMPUTING, HCC 2014, 2015, 8944 : 278 - 289
[4] Energy Utilization Task Scheduling for MapReduce in Heterogeneous Clusters
Wang, Jia
Li, Xiaoping
Ruiz, Ruben
Yang, Jie
Chu, Dianhui
[J]. IEEE TRANSACTIONS ON SERVICES COMPUTING, 2022, 15 (02) : 931 - 944
[5] Energy-aware Task Scheduling of MapReduce Cluster
Wang, Jia
Li, Xiaoping
Yang, Jie
[J]. 2015 INTERNATIONAL CONFERENCE ON SERVICE SCIENCE (ICSS), 2015, : 187 - 194
[6] HTD: heterogeneous throughput-driven task scheduling algorithm in MapReduce
Xite Wang
Chaojin Wang
Mei Bai
Qian Ma
Guanyu Li
[J]. Distributed and Parallel Databases, 2022, 40 : 135 - 163
[7] HTD: heterogeneous throughput-driven task scheduling algorithm in MapReduce
Wang, Xite
Wang, Chaojin
Bai, Mei
Ma, Qian
Li, Guanyu
[J]. DISTRIBUTED AND PARALLEL DATABASES, 2022, 40 (01) : 135 - 163
[8] MapReduce Task Scheduling in Heterogeneous Geo-Distributed Data Centers
Li, Xiaoping
Chen, Fuchao
Ruiz, Ruben
Zhu, Jie
[J]. IEEE TRANSACTIONS ON SERVICES COMPUTING, 2022, 15 (06) : 3317 - 3329
[9] A Novel Task Scheduling Approach for Reducing Energy Consumption of MapReduce Cluster
Song, Jie
Liu, Xuebing
Zhu, Zhiliang
Zhao, Dazhe
Yu, Ge
[J]. IETE TECHNICAL REVIEW, 2014, 31 (01) : 65 - 74
[10] Prediction-Based and Locality-Aware Task Scheduling for Parallelizing Video Transcoding Over Heterogeneous MapReduce Cluster
Zhao, Hui
Zheng, Qinghua
Zhang, Weizhan
Wang, Jing
[J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2018, 28 (04) : 1009 - 1020

← 1 2 3 4 5 →