Performance Analysis Using Petri Net Based MapReduce Model in Heterogeneous Clusters

被引:2
|
作者
Cheng, Sheng-Tzong [1 ]
Wang, Hsi-Chuan [1 ]
Chen, Yin-Jun [1 ]
Chen, Chen-Fei [2 ]
机构
[1] Natl Cheng Kung Univ, Dept Comp Sci & Informat Engn, Tainan 70101, Taiwan
[2] Shih Hsin Univ, Dept Informat & Communicat, Taipei, Taiwan
来源
关键词
Cloud computing; MapReduce; Petri net; Performance analysis;
D O I
10.1007/978-3-662-46315-4_18
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Currently, big data and large-scale data processing techniques has become an important developing area. MapReduce is an enabling technology of cloud computing. Hadoop is one of the most popular MapReduce implementation, which is the target platform in this paper. When running a MapReduce job, programmers however cannot acquire the information about how to fine-tune the parameters of application. Moreover, programmers need much time on finding the most suitable parameters. This paper evaluates execution processes in MapReduce and form SPN-MR model with Stochastic Petri Net. In order to analyze the performance of SPN-MR, formulas of mean delay time in each time transition are defined. SPN-MR simulates the elapsed time of any MapReduce jobs with known input data sizes and then reduces time cost in performance tuning. SPN-MR carried out several actual test benchmarks. The results showed the average error rate is within 5 percent. Therefore, it can provide effective performance evaluation reports for MapReduce programmers.
引用
收藏
页码:170 / 179
页数:10
相关论文
共 50 条
  • [11] Analysis of the concurrent model of train station based on Petri net
    Tang, L
    Chen, TL
    Xiao, J
    [J]. 2000 INTERNATIONAL WORKSHOP ON AUTONOMOUS DECENTRALIZED SYSTEM, PROCEEDINGS, 2000, : 92 - 96
  • [12] Runway Utilization Analysis Based on the Stochastic Petri Net Model
    Jiang, Gaoyang
    Wang, Jiening
    Zhang, Chunfeng
    Dong, Mei
    [J]. INFORMATION TECHNOLOGY APPLICATIONS IN INDUSTRY II, PTS 1-4, 2013, 411-414 : 1750 - +
  • [13] Improving Hadoop MapReduce performance on heterogeneous single board computer clusters☆
    Lim, Sooyoung
    Park, Dongchul
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 160 : 752 - 766
  • [14] Model Checking Workflow Net Based on Petri Net
    ZHOU Conghua~1
    2. School of Computer Science and Engineering
    [J]. Wuhan University Journal of Natural Sciences, 2006, (05) : 1297 - 1301
  • [15] Designing a MapReduce performance model in distributed heterogeneous platforms based on benchmarking approach
    Gandomi, Abolfazl
    Movaghar, Ali
    Reshadi, Midia
    Khademzadeh, Ahmad
    [J]. JOURNAL OF SUPERCOMPUTING, 2020, 76 (09): : 7177 - 7203
  • [16] Designing a MapReduce performance model in distributed heterogeneous platforms based on benchmarking approach
    Abolfazl Gandomi
    Ali Movaghar
    Midia Reshadi
    Ahmad Khademzadeh
    [J]. The Journal of Supercomputing, 2020, 76 : 7177 - 7203
  • [17] Disk logging algorithms and performance analysis based on Petri net models
    Zhou, Feng
    Lin, Chuang
    Zheng, Wei-Min
    [J]. 2002, Chinese Academy of Sciences (13):
  • [18] Performance modeling and analysis of a switching router based on stochastic petri net
    Wang, Q
    Liu, B
    [J]. 2003 INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY, VOL 1 AND 2, PROCEEDINGS, 2003, : 543 - 546
  • [19] Invariant-Based Performance Analysis of Timed Petri Net Models
    Zuberek, W. M.
    [J]. DEPENDABILITY ENGINEERING AND COMPLEX SYSTEMS, 2016, 470 : 595 - 604
  • [20] Petri Net distributed simulation using HLA based on Petri net components
    Combettes, S
    Nketsa, A
    [J]. Modelling and Simulation 2003, 2003, : 503 - 507