Investigation of Network Traffic in Geo-Distributed Data Centers

被引：0
|
作者：
Koshiba, Yutaka [1 ]
Chen, Wuhui [1 ]
Yamada, Yuichi [1 ]
Tanaka, Takazumi [1 ]
Paik, Incheon [1 ]
机构：
[1] Univ Aizu, Sch Comp Sci & Engn, Aizu Wakamatsu, Japan
来源：
2015 IEEE 7TH INTERNATIONAL CONFERENCE ON AWARENESS SCIENCE & TECHNOLOGY (ICAST) | 2015年
关键词：
Hadoop; big data infrastructure; MapReduce; Geo-distributed data center; network traffic;
D O I：
暂无
中图分类号：
TM [电工技术]; TN [电子技术、通信技术];
学科分类号：
0808 ; 0809 ;
摘要：
Understanding characteristics of network traffic in a Hadoop cluster is a key to check existing problems in order to improve them for better performance of MapReduce operations. However, current works is focusing on analyzing MapReduce performance within one single data center, but network traffic in a geo-distributed data centers environment has not been well-studied yet. In this paper, we study the network traffic characteristics in geo-distributed data centers and identify some interesting results. We first construct geo-distributed data centers by adding latency among data center clusters with 18 data nodes. Then we collect traffic log data by running MapReduce applications on the geo-distributed data centers. Finally, by analyzing the log data, we found some interesting results for our future research.
引用
收藏
页码：174 / 179
页数：6
相关论文
共 50 条
  • [41] Network Cost-Aware Geo-Distributed Data Analytics System
    Oh, Kwangsung
    Zhang, Minmin
    Chandra, Abhishek
    Weissman, Jon
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2022, 33 (06) : 1407 - 1420
  • [42] Analysis of Control Traffic in a Geo-distributed Collaborative Cloud
    Sciammarella, Tatiana
    Couto, Rodrigo S.
    Rubinstein, Marcelo G.
    Campista, Miguel Elias M.
    Costa, Luis Henrique M. K.
    [J]. 2016 5TH IEEE INTERNATIONAL CONFERENCE ON CLOUD NETWORKING (IEEE CLOUDNET), 2016, : 224 - 229
  • [43] EVPN/SDN Assisted Live VM Migration between Geo-Distributed Data Centers
    Noghani, Kyoomars Alizadeh
    Kassler, Andreas
    Gopannan, Prem Sankar
    [J]. 2018 4TH IEEE CONFERENCE ON NETWORK SOFTWARIZATION AND WORKSHOPS (NETSOFT), 2018, : 105 - 113
  • [44] Efficient Geo-Distributed Data Processing with Rout
    Jayalath, Chamikara
    Eugster, Patrick
    [J]. 2013 IEEE 33RD INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS), 2013, : 470 - 480
  • [45] A Hybrid Learning Framework for Service Function Chaining Across Geo-Distributed Data Centers
    Tang, Tao
    Wu, Binwei
    Hu, Guangmin
    [J]. IEEE ACCESS, 2020, 8 : 170225 - 170236
  • [46] Dual Optimization of Revenue and Expense in Geo-Distributed Data Centers Using Smart Grid
    Khalid, Saifullah
    Ahmad, Ishfaq
    [J]. IEEE TRANSACTIONS ON CLOUD COMPUTING, 2023, 11 (02) : 1622 - 1635
  • [47] An Optimal Task Placement Strategy in Geo-Distributed Data Centers Involving Renewable Energy
    Wang, Ran
    Lu, Yiwen
    Zhu, Kun
    Hao, Jie
    Wang, Ping
    Cao, Yue
    [J]. IEEE ACCESS, 2018, 6 : 61948 - 61958
  • [48] Exploiting Spatio-Temporal Diversity for Water Saving in Geo-Distributed Data Centers
    Islam, Mohammad A.
    Ahmed, Kishwar
    Xu, Hong
    Tran, Nguyen H.
    Quan, Gang
    Ren, Shaolei
    [J]. IEEE TRANSACTIONS ON CLOUD COMPUTING, 2018, 6 (03) : 734 - 746
  • [49] Customer satisfaction-aware scheduling for utility maximization on geo-distributed data centers
    Jing, Chao
    Zhu, Yanmin
    Li, Minglu
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2015, 27 (05): : 1334 - 1354
  • [50] Joint Workload Scheduling Method in Geo-Distributed Data Centers Considering UPS Loss
    Ye, Guisen
    Gao, Feng
    [J]. 2021 IEEE IAS INDUSTRIAL AND COMMERCIAL POWER SYSTEM ASIA (IEEE I&CPS ASIA 2021), 2021, : 50 - 57
12345