On the design of distributed object placement and load balancing strategies in large-scale networked multimedia storage systems

被引:16
|
作者
Zeng, Zeng [1 ]
Veeravalli, Bharadwaj [1 ]
机构
[1] Natl Univ Singapore, Dept Elect & Comp Engn, Comp Networks & Distributed Syst Lab, Singapore 117576, Singapore
关键词
multimedia storage system; request balancing; distributed system; average waiting time; queuing theory;
D O I
10.1109/TKDE.2007.190694
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In a large-scale multimedia storage system (LMSS) where client requests for different multimedia objects may have different demands, the placement and replication of the objects is an important factor, as it may result in an imbalance in server loading across the system. Since replication management and load balancing are all the more crucial issues in multimedia systems, in the literature, these problems are handled by centralized servers. Each object storage server (OSS) responds to the requests that come from the centralized servers independently and has no communication with other OSSs in the system. In this paper, we design a novel distributed load balancing strategy for LMSS, in which OSSs can cooperate to achieve higher performance. Such OSS modeled as an M/G/m system can replicate the objects to and balance the requests among other servers to achieve a near-optimal average waiting time (AWT) of the requests in the system. We validate the performance of the system via rigorous simulations with respect to several influencing factors and prove that our proposed strategy is scalable, flexible, and efficient for real-life applications.
引用
收藏
页码:369 / 382
页数:14
相关论文
共 50 条
  • [1] DistCache: Provable Load Balancing for Large-Scale Storage Systems with Distributed Caching
    Liu, Zaoxing
    Bai, Zhihao
    Liu, Zhenming
    Li, Xiaozhou
    Kim, Changhoon
    Braverman, Vladimir
    Jin, Xin
    Stoica, Ion
    [J]. PROCEEDINGS OF THE 17TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, 2019, : 143 - 157
  • [2] A Replica-Conscious Load Balancing Strategy for Large-Scale Multimedia Storage Systems
    Zeng, Zeng
    Veeravalli, Bharadwaj
    [J]. GLOBECOM 2006 - 2006 IEEE GLOBAL TELECOMMUNICATIONS CONFERENCE, 2006,
  • [3] Impact of Data Placement on Resilience in Large-Scale Object Storage Systems
    Carns, Philip
    Harms, Kevin
    Jenkins, John
    Mubarak, Misbah
    Ross, Robert
    Carothers, Christopher
    [J]. 2016 32ND SYMPOSIUM ON MASS STORAGE SYSTEMS AND TECHNOLOGIES (MSST), 2016,
  • [4] A Novel Architecture Design of Large-Scale Distributed Object Storage System
    Ying, Shan
    Yao Nian-min
    [J]. INTERNATIONAL JOURNAL OF GRID AND DISTRIBUTED COMPUTING, 2015, 8 (01): : 25 - 32
  • [5] A load balancing strategy for large-scale distributed computing
    Yang, Ji-Xiang
    Tan, Guo-Zhen
    Wang, Fan
    Zhou, Mei-Na
    [J]. Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2012, 40 (11): : 2226 - 2231
  • [6] Load balancing in large-scale RFID systems
    Dong, Qunfeng
    Shukla, Ashutosh
    Shrivastava, Vivek
    Agrawal, Dheeraj
    Banerjee, Suman
    Kar, Koushik
    [J]. COMPUTER NETWORKS, 2008, 52 (09) : 1782 - 1796
  • [7] Load balancing in large-scale heterogeneous systems
    Sem Borst
    [J]. Queueing Systems, 2022, 100 : 397 - 399
  • [8] Load balancing in large-scale RFID systems
    Dong, Qunfeng
    Shukla, Ashutosh
    Shrivastava, Vivek
    Agrawal, Dheeraj
    Baneriee, Suman
    Kar, Koushik
    [J]. INFOCOM 2007, VOLS 1-5, 2007, : 2281 - +
  • [9] Efficient Load Balancing In Large-Scale Systems
    Mukherjee, D.
    Borst, S. C.
    van Leeuwaarden, J. S. H.
    Whiting, P. A.
    [J]. 2016 ANNUAL CONFERENCE ON INFORMATION SCIENCE AND SYSTEMS (CISS), 2016,
  • [10] Load balancing in large-scale heterogeneous systems
    Borst, Sem
    [J]. QUEUEING SYSTEMS, 2022, 100 (3-4) : 397 - 399