AN ANALYTICAL PERFORMANCE MODEL OF MAPREDUCE

被引:0
|
作者
Yang, Xiao [1 ]
Sun, Jianling [1 ]
机构
[1] Zhejiang Univ, Dept Comp Sci & Technol, Hangzhou, Zhejiang, Peoples R China
关键词
performance model; MapReduce; distributed computing;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
MapReduce is a distributed computing framework. Its application in distributed systems is a rapidly emerging field. Although this framework can leverage clusters to improve computing performance, tuning it is still challenging. Most current works related to MapReduce performance are based on system monitoring and simulation, and lack analytical performance models. In this paper, we propose a simple and general MapReduce performance model for better understanding the impact of each component on overall. program performance, and verify it in a small cluster. The results indicate that our model can predict the performance of MapReduce system and its relation to the configuration. According to our model, performance can be. improved. significantly by modifying Map split granularity and number of reducers without modifying the framework. The model also points out potential bottlenecks of the framework and future improvement for better performance.
引用
收藏
页码:306 / 310
页数:5
相关论文
共 50 条
  • [31] Analytical ion thruster discharge performance model
    Goebel, Dan M.
    Wirz, Richard E.
    Katz, Ira
    [J]. JOURNAL OF PROPULSION AND POWER, 2007, 23 (05) : 1055 - 1067
  • [32] An analytical model for the performance of the DOCSIS CATV network
    Liu, ZL
    Xu, CY
    [J]. COMPUTER JOURNAL, 2002, 45 (03): : 278 - 284
  • [33] An analytical performance model of IP-SAN
    Wang, Min
    Liu, Liu
    Xu, Wei
    Xu, Lu
    [J]. PROCEEDINGS OF THE 2008 IEEE INTERNATIONAL CONFERENCE ON NETWORKING, ARCHITECTURE, AND STORAGE, 2008, : 255 - 262
  • [34] An analytical model of oscillating heat pipe performance
    Pawlick, Max
    Peterson, G. P.
    [J]. THERMAL SCIENCE AND ENGINEERING PROGRESS, 2024, 50
  • [35] Analytical model for performance prediction of linear resolver
    Saneie, Hamid
    Nasiri-Gheidari, Zahra
    Tootoonchian, Farid
    [J]. IET ELECTRIC POWER APPLICATIONS, 2017, 11 (08) : 1457 - 1465
  • [36] A static analytical performance model for GPU kernel
    Li, Jingjin
    Chen, Qingkui
    Liu, Bocheng
    [J]. INTERNATIONAL JOURNAL OF COMPUTATIONAL SCIENCE AND ENGINEERING, 2019, 18 (02) : 201 - 210
  • [37] An analytical performance model of robotic storage libraries
    Johnson, T
    [J]. PERFORMANCE EVALUATION, 1996, 27-8 : 231 - 251
  • [38] Development of analytical model of cantilever hook performance
    Suri, G
    Luscher, AF
    [J]. JOURNAL OF MECHANICAL DESIGN, 2006, 128 (02) : 479 - 493
  • [39] Analytical Model for Vertically Loaded Anchor Performance
    Aubeny, Charles
    Chi, Chao-Ming
    [J]. JOURNAL OF GEOTECHNICAL AND GEOENVIRONMENTAL ENGINEERING, 2014, 140 (01) : 14 - 24
  • [40] Improving Encryption Performance using MapReduce
    Desai, Sanket
    Park, Younghee
    Gao, Jerry
    Chang, Sang-Yoon
    Song, Chungsik
    [J]. 2015 IEEE 17TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS, 2015 IEEE 7TH INTERNATIONAL SYMPOSIUM ON CYBERSPACE SAFETY AND SECURITY, AND 2015 IEEE 12TH INTERNATIONAL CONFERENCE ON EMBEDDED SOFTWARE AND SYSTEMS (ICESS), 2015, : 1350 - 1355