A Low-Latency Metadata Service for Geo-Distributed File Systems

被引:1
|
作者
Lin, Chuangwei [1 ]
Liu, Bowen [1 ]
Zhou, Wei [1 ]
Xu, Yueyue [1 ]
Zhang, Xuyun [2 ]
Dou, Wanchun [1 ]
机构
[1] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing, Peoples R China
[2] Macquarie Univ, Dept Comp, Sydney, Australia
关键词
Distributed file system; Low latency; Metadata service; Wide area storage;
D O I
10.1007/978-3-030-90888-1_7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Geo-distributed file systems have been widely used byweb services. An increasing number of time-critical web applications have been deployed on the cloud across geographical regions. In this circumstance, intolerant service latency will occur when user accesses remote servers. In view of this challenge, We design a metadata service which aims at reducing the service invocation latency. This low-latencymetadata service is named LoLaMS. Taking advantage of the latency-aware dynamic subtree partition and migration, LoLaMS is capable to handle more metadata service invocations in the near by metadata server. On account of that, the expected latency could be satisfied by LoLaMS. We implemented the LoLaMS and deployed it in a real-word cloud environment across different regions. The experimental results show that LoLaMS reduces the network latency effectively while ensuring high metadata consistency.
引用
收藏
页码:87 / 100
页数:14
相关论文
共 50 条
  • [1] Low-Latency and Scalable Full-path Indexing Metadata Service for Distributed File Systems
    Dong, Chao
    Wang, Fang
    Yang, Yuxin
    Lei, Mengya
    Zhang, Jianshun
    Feng, Dan
    [J]. 2023 IEEE 41ST INTERNATIONAL CONFERENCE ON COMPUTER DESIGN, ICCD, 2023, : 283 - 290
  • [2] Low Latency Geo-distributed Data Analytics
    Pu, Qifan
    Ananthanarayanan, Ganesh
    Bodik, Peter
    Kandula, Srikanth
    Akella, Aditya
    Bahl, Paramvir
    Stoica, Ion
    [J]. ACM SIGCOMM COMPUTER COMMUNICATION REVIEW, 2015, 45 (04) : 421 - 434
  • [3] Low Latency Geo-distributed Data Analytics
    Pu, Qifan
    Ananthanarayanan, Ganesh
    Bodik, Peter
    Kandula, Srikanth
    Akella, Aditya
    Bahl, Paramvir
    Stoica, Ion
    [J]. SIGCOMM'15: PROCEEDINGS OF THE 2015 ACM CONFERENCE ON SPECIAL INTEREST GROUP ON DATA COMMUNICATION, 2015, : 421 - 434
  • [4] Caerus: Low-Latency Distributed Transactions for Geo-Replicated Systems
    Hildred, Joshua
    Abebe, Michael
    Daudjee, Khuzaima
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2023, 17 (03): : 469 - 482
  • [5] Transaction chains: achieving serializability with low latency in geo-distributed storage systems
    Zhang, Yang
    Power, Russell
    Zhou, Siyuan
    Sovran, Yair
    Aguilera, Marcos
    Li, Jinyang
    [J]. SOSP'13: PROCEEDINGS OF THE TWENTY-FOURTH ACM SYMPOSIUM ON OPERATING SYSTEMS PRINCIPLES, 2013, : 276 - 291
  • [6] A Flattened Metadata Service for Distributed File Systems
    Li, Siyang
    Liu, Fenlin
    Shu, Jiwu
    Lu, Youyou
    Li, Tao
    Hu, Yang
    [J]. IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2018, 29 (12) : 2641 - 2657
  • [7] Minimizing latency in geo-distributed clouds
    Malekimajd, Marzieh
    Movaghar, Ali
    Hosseinimotlagh, Seyedmahyar
    [J]. JOURNAL OF SUPERCOMPUTING, 2015, 71 (12): : 4423 - 4445
  • [8] Minimizing latency in geo-distributed clouds
    Marzieh Malekimajd
    Ali Movaghar
    Seyedmahyar Hosseinimotlagh
    [J]. The Journal of Supercomputing, 2015, 71 : 4423 - 4445
  • [9] Cost-aware & Fault-tolerant Geo-distributed Edge Computing for Low-latency Stream Processing
    Xu, Jinlai
    Palanisamy, Balaji
    [J]. 2021 IEEE 7TH INTERNATIONAL CONFERENCE ON COLLABORATION AND INTERNET COMPUTING (CIC 2021), 2021, : 117 - 124
  • [10] A Distributed Cache Framework for Metadata Service of Distributed File Systems
    Sun, Yao
    Liu, Jie
    Ye, Dan
    Zhong, Hua
    [J]. 2013 19TH IEEE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS 2013), 2013, : 51 - 58