DYNAMIC SCHEDULING ALGORITHM FOR REDUCING START TIME IN HADOOP

被引:3
|
作者
Gunasekaran, S. [1 ]
SaiRamesh, L. [2 ]
Sabena, S. [3 ]
Selvakumar, K. [4 ]
Ganapathy, S. [5 ]
Kannan, A. [2 ]
机构
[1] Anna Univ Chennai, Chennai, Tamil Nadu, India
[2] Anna Univ, Chennai, Tamil Nadu, India
[3] Anna Univ, Reg Ctr, Tirunelveli, India
[4] VIT Univ Vellore, Vellore, Tamil Nadu, India
[5] VIT Univ, Chennai, Tamil Nadu, India
关键词
Big data; Mapreduce; Self Adaptive Scheduling; Dynamic Scheduling; Task scheduling; MAPREDUCE;
D O I
10.1145/2980258.2982115
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Map Reduce is a model associated with a programming and implementation method and is used for formulating on large datasets. The main challenge is scaling of start blocks and present implementations might end in a block of scale back tasks. In this work, In this work, a new start up model is proposed using temporal constraints and hence, the map task gives a massive output then the performance of Map Reduce reduces drastically. Through this analysis the map reduce planning mechanism is modified to reduce the waste resources in the system slot. This tends to an end within the scale back tasks waiting around the proposed model scale back the planning policy for reducing the waiting of scales back tasks and begin times within the Hadoop platform. It also decides the beginning time and purpose of every scale back task dynamically based on the context of each job, together with the task completion time and therefore the size of map as output. Thereafter, scale back completion time and system average latent period job completion time have been estimated. The experimental results illustrate that the scale back completion time has been decreased sharply due to the rise of the temporal rules and map reduce techniques.
引用
收藏
页数:4
相关论文
共 50 条
  • [1] Integrated Scheduling Algorithm for Dynamic Adjustment of Equipment Maintenance Start Time
    Xie, Zhiqiang
    Zhou, Wei
    Yu, Zerui
    [J]. Jixie Gongcheng Xuebao/Journal of Mechanical Engineering, 2021, 57 (04): : 240 - 246
  • [2] Self-learning dynamic adjustment scheduling algorithm based on Hadoop
    Li, Fucong
    Li, Zhuyu
    Chen, Guohui
    Li, Xiangxin
    [J]. PROCEEDINGS OF THE 2015 3RD INTERNATIONAL CONFERENCE ON MACHINERY, MATERIALS AND INFORMATION TECHNOLOGY APPLICATIONS, 2015, 35 : 314 - 318
  • [3] Tolhit - A Scheduling Algorithm for Hadoop Cluster
    Brahmwar, M.
    Kumar, M.
    Sikka, G.
    [J]. TWELFTH INTERNATIONAL CONFERENCE ON COMMUNICATION NETWORKS, ICCN 2016 / TWELFTH INTERNATIONAL CONFERENCE ON DATA MINING AND WAREHOUSING, ICDMW 2016 / TWELFTH INTERNATIONAL CONFERENCE ON IMAGE AND SIGNAL PROCESSING, ICISP 2016, 2016, 89 : 203 - 208
  • [4] A Task Scheduling Algorithm for Hadoop Platform
    Chen, Jilan
    Wang, Dan
    Zhao, Wenbing
    [J]. JOURNAL OF COMPUTERS, 2013, 8 (04) : 929 - 936
  • [5] Hadoop-based Dynamic Load Balance Scheduling Algorithm of Logistics Inventory
    Li, Wenjing
    Zhou, Jie
    Lin, Zhong-Ming
    Zhang, Xiang-bo
    [J]. PROCEEDINGS OF 2016 12TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND SECURITY (CIS), 2016, : 5 - 8
  • [6] Dynamic Proportional Share Scheduling in Hadoop
    Sandholm, Thomas
    Lai, Kevin
    [J]. JOB SCHEDULING STRATEGIES FOR PARALLEL PROCESSING, 2010, 6253 : 110 - 131
  • [7] A Scheduling Algorithm for Reducing FlexRay Message Response Time Using Empty Minislots in Dynamic Segment
    Park, Kiejin
    Kang, Minkoo
    Kim, Bongjun
    [J]. 2010 DIGEST OF TECHNICAL PAPERS INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS ICCE, 2010,
  • [8] A self-adaptive scheduling algorithm for reduce start time
    Tang, Zhuo
    Jiang, Lingang
    Zhou, Junqing
    Li, Kenli
    Li, Keqin
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2015, 43-44 : 51 - 60
  • [9] ALGORITHM FOR REDUCING TIME REQUIREMENTS ON START UP OF RECTIFICATION COLUMNS
    KRUSE, C
    FIEG, G
    WOZNY, G
    JEROMIN, L
    [J]. CHEMIE INGENIEUR TECHNIK, 1995, 67 (04) : 458 - 461
  • [10] Dynamic Colocation Algorithm For Hadoop
    Babu, B. Ganesh
    Shabeera, T. P.
    Kumar, Madhu S. D.
    [J]. 2014 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATIONS AND INFORMATICS (ICACCI), 2014, : 2643 - 2647