Efficient Process Mapping in Geo-Distributed Cloud Data Centers

被引:10
|
作者
Zhou, Amelie Chi [1 ,5 ]
Gong, Yifan [2 ]
He, Bingsheng [3 ]
Zhai, Jidong [4 ]
机构
[1] Shenzhen Univ, Shenzhen, Peoples R China
[2] TuSimple, Beijing, Peoples R China
[3] Natl Univ Singapore, Singapore, Singapore
[4] Tsinghua Univ, Beijing, Peoples R China
[5] INRIA, Rennes, France
关键词
Process Mapping; Geo-distributed Data Centers; Cloud Computing; OPTIMIZATION;
D O I
10.1145/3126908.3126913
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Recently, various applications including data analytics and machine learning have been developed for geo-distributed cloud data centers. For those applications, the ways to map parallel processes to physical nodes (i.e., "process mapping") could significantly impact the performance of the applications because of non-uniform communication cost in such geo-distributed environments. While process mapping has been widely studied in grid/cluster environments, few of the existing studies have considered the problem in geo-distributed cloud environments. In this paper, we propose a novel model to formulate the geo-distributed process mapping problem and develop a new method to efficiently find the near optimal solution. Our algorithm considers both the network communication performance of geo-distributed data centers as well as the communication matrix of the target application. Evaluation results with real experiments on Amazon EC2 and simulations demonstrate that our proposal achieves significant performance improvement (50% on average) compared to the state-of-the-art algorithms.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Privacy Regulation Aware Process Mapping in Geo-Distributed Cloud Data Centers
    Zhou, Amelie Chi
    Xiao, Yao
    Gong, Yifan
    He, Bingsheng
    Zhai, Jidong
    Mao, Rui
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2019, 30 (08) : 1872 - 1888
  • [2] Data Centers Selection for Moving Geo-distributed Big Data to Cloud
    Zhang, Jiangtao
    Yuan, Qiang
    Chen, Shi
    Huang, Hejiao
    Wang, Xuan
    [J]. JOURNAL OF INTERNET TECHNOLOGY, 2019, 20 (01): : 111 - 122
  • [3] Towards Efficient Graph Processing in Geo-Distributed Data Centers
    Yao, Feng
    Tao, Qian
    Lin, Shengyuan
    Zhang, Yanfeng
    Yu, Wenyuan
    Gong, Shufeng
    Wang, Qiange
    Yu, Ge
    Zhou, Jingren
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2024, 35 (11) : 2147 - 2160
  • [4] Dynamic Pricing and Profit Maximization for the Cloud with Geo-distributed Data Centers
    Zhao, Jian
    Li, Flongxing
    Wu, Chuan
    Li, Zongpeng
    Zhang, Zhizhong
    Lau, Francis C. M.
    [J]. 2014 PROCEEDINGS IEEE INFOCOM, 2014, : 118 - 126
  • [5] Planning of Geo-Distributed Cloud Data Centers in Fast Developing Economies
    Liu, Ruiyun
    Sun, Weiqiang
    Hu, Weisheng
    [J]. 2018 20TH ANNIVERSARY INTERNATIONAL CONFERENCE ON TRANSPARENT OPTICAL NETWORKS (ICTON), 2018,
  • [6] Revenue Maximization for Dynamic Expansion of Geo-Distributed Cloud Data Centers
    Deng, Hou
    Huang, Liusheng
    Xu, Hongli
    Liu, Xiangyan
    Wang, Pengzhan
    Fang, Xianjing
    [J]. IEEE TRANSACTIONS ON CLOUD COMPUTING, 2020, 8 (03) : 899 - 913
  • [7] Hierarchical Approach for Efficient Workload Management in Geo-Distributed Data Centers
    Forestiero, Agostino
    Mastroianni, Carlo
    Meo, Michela
    Papuzzo, Giuseppe
    Sheikhalishahi, Mehdi
    [J]. IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2017, 1 (01): : 97 - 111
  • [8] Cost Efficient Design of Fault Tolerant Geo-Distributed Data Centers
    Tripathi, Rakesh
    Vignesh, S.
    Tamarapalli, Venkatesh
    Medhi, Deep
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2017, 14 (02): : 289 - 301
  • [9] Green Computing with Geo-Distributed Heterogeneous Data Centers
    Pasricha, Sudeep
    Hogade, Ninad
    Siegel, Howard Jay
    Maciejewski, Anthony A.
    [J]. 2019 TENTH INTERNATIONAL GREEN AND SUSTAINABLE COMPUTING CONFERENCE (IGSC), 2019,
  • [10] Efficient Geo-Distributed Data Processing with Rout
    Jayalath, Chamikara
    Eugster, Patrick
    [J]. 2013 IEEE 33RD INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS), 2013, : 470 - 480