Efficient Process Mapping in Geo-Distributed Cloud Data Centers

被引:10
|
作者
Zhou, Amelie Chi [1 ,5 ]
Gong, Yifan [2 ]
He, Bingsheng [3 ]
Zhai, Jidong [4 ]
机构
[1] Shenzhen Univ, Shenzhen, Peoples R China
[2] TuSimple, Beijing, Peoples R China
[3] Natl Univ Singapore, Singapore, Singapore
[4] Tsinghua Univ, Beijing, Peoples R China
[5] INRIA, Rennes, France
关键词
Process Mapping; Geo-distributed Data Centers; Cloud Computing; OPTIMIZATION;
D O I
10.1145/3126908.3126913
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Recently, various applications including data analytics and machine learning have been developed for geo-distributed cloud data centers. For those applications, the ways to map parallel processes to physical nodes (i.e., "process mapping") could significantly impact the performance of the applications because of non-uniform communication cost in such geo-distributed environments. While process mapping has been widely studied in grid/cluster environments, few of the existing studies have considered the problem in geo-distributed cloud environments. In this paper, we propose a novel model to formulate the geo-distributed process mapping problem and develop a new method to efficiently find the near optimal solution. Our algorithm considers both the network communication performance of geo-distributed data centers as well as the communication matrix of the target application. Evaluation results with real experiments on Amazon EC2 and simulations demonstrate that our proposal achieves significant performance improvement (50% on average) compared to the state-of-the-art algorithms.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Cost Minimization for Big Data Processing in Geo-Distributed Data Centers
    Gu, Lin
    Zeng, Deze
    Li, Peng
    Guo, Song
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2014, 2 (03) : 314 - 323
  • [22] VNF Deployment and Flow Scheduling in Geo-distributed Data Centers
    Gu, Lin
    Chen, Xiaoxiao
    Jin, Hai
    Lu, Feng
    [J]. 2018 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2018,
  • [23] Dynamic Data Replication Across Geo-Distributed Cloud Data Centres
    Jayalakshmi, D. S.
    Ranjana, T. P. Rashmi
    Ramaswamy, Srinivasan
    [J]. DISTRIBUTED COMPUTING AND INTERNET TECHNOLOGY (ICDCIT 2016), 2016, 9581 : 182 - 187
  • [24] A Scheduling Framework for Periodic Tasks in Geo-Distributed Data Centers
    Li, Yan
    Zhang, Hong
    Wang, Yong
    Liu, Xinran
    Zhang, Peng
    [J]. 9TH IEEE INTERNATIONAL SYMPOSIUM ON SERVICE-ORIENTED SYSTEM ENGINEERING (SOSE 2015), 2015, : 247 - 252
  • [25] Analysis of Cost Minimization Methods in Geo-Distributed Data Centers
    Khalaf, Ayesheh Ahrari
    Abdalla, Aisha Hassan
    [J]. PROCEEDINGS OF 6TH INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATION ENGINEERING (ICCCE 2016), 2016, : 241 - 245
  • [26] Joint Scheduling of Data and Computation in Geo-distributed Cloud Systems
    Yin, Lingyan
    Sun, Jizhou
    Zhao, Laiping
    Cui, Chenzhou
    Xiao, Jian
    Yu, Ce
    [J]. 2015 15TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING, 2015, : 657 - 666
  • [27] Carbon-Efficient Virtual Machine Placement Based on Dynamic Voltage Frequency Scaling in Geo-Distributed Cloud Data Centers
    Renugadevi, T.
    Geetha, K.
    Prabaharan, Natarajan
    Siano, Pierluigi
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (08):
  • [28] Joint Request Mapping and Response Routing for Geo-distributed Cloud Services
    Xu, Hong
    Li, Baochun
    [J]. 2013 PROCEEDINGS IEEE INFOCOM, 2013, : 854 - 862
  • [29] Cost-Efficient Resource Scheduling under QoS Constraints for Geo-Distributed Data Centers
    Maswood, Mirza Mohd Shahriar
    Nasim, Robayet
    Kassler, Andreas J.
    Medhi, Deep
    [J]. NOMS 2018 - 2018 IEEE/IFIP NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM, 2018,
  • [30] Time- and Cost- Efficient Task Scheduling across Geo-Distributed Data Centers
    Hu, Zhiming
    Li, Baochun
    Luo, Jun
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2018, 29 (03) : 705 - 718