File allocation algorithms to minimize data transmission time in distributed computing systems

被引:0
|
作者
Chang, PY [1 ]
Chen, DJ
Kavi, KM
机构
[1] Ta Hwa Inst Technol, Informat Management Dept, Hsinchu 307, Taiwan
[2] Natl Chiao Tung Univ, Dept Comp Sci & Informat Engn, Hsinchu 300, Taiwan
[3] Univ Alabama, Dept Elect & Comp Engn, Huntsville, AL 35899 USA
关键词
distributed computing system (DCS); cut; multi-commodity flow; linear programming; data replication; branch and bound;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work addresses a files allocation problem (FAP) in distributed computing systems. This FAP attempts to minimize the expected data transfer time for a specific program that must access several data files from non-perfect computer sites. We assume that communication capacity can be reserved; hence, the data transmission behavior is modeled as a many-to-one multi-commodity flow problem. A new critical-cut method is proposed to solve this reduced multi-commodity flow problem. Based on this method, two algorithms which use branch-and-bound are proposed for this FAR The proposed algorithms are able to allocate data files having single copies or multiple replicated copies. Simulation results are presented to demonstrate the performance of the algorithms.
引用
收藏
页码:633 / 646
页数:14
相关论文
共 50 条
  • [21] A high-performance computing method for data allocation in distributed database systems
    Ismail Omar Hababeh
    Muthu Ramachandran
    Nicholas Bowring
    The Journal of Supercomputing, 2007, 39 : 3 - 18
  • [22] A TASK ALLOCATION MODEL FOR DISTRIBUTED COMPUTING SYSTEMS
    MA, PYR
    LEE, EYS
    TSUCHIYA, M
    IEEE TRANSACTIONS ON COMPUTERS, 1982, 31 (01) : 41 - 47
  • [23] On task allocation in heterogeneous distributed computing systems
    Ignatius, PP
    Murthy, CSR
    COMPUTER SYSTEMS SCIENCE AND ENGINEERING, 1997, 12 (04): : 231 - 238
  • [24] On task allocation in heterogeneous distributed computing systems
    Indian Inst of Technology, Madras, India
    Comput Syst Sci Eng, 4 (231-238):
  • [25] Linear-time algorithms for computing the reliability of bipartite and (# ≤ 2) star distributed computing systems
    Lin, MS
    COMPUTERS & OPERATIONS RESEARCH, 2003, 30 (11) : 1697 - 1712
  • [26] Data Replication for Reducing Computing Time in Distributed Systems with Stragglers
    Behrouzi-Far, Amir
    Soljanin, Emina
    2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 5986 - 5988
  • [27] Sensitivity analysis in optimal design for distributed file allocation systems
    Nakaniwa, A
    Onishi, M
    Ebara, H
    Okada, H
    IEICE TRANSACTIONS ON COMMUNICATIONS, 2001, E84B (06) : 1655 - 1663
  • [28] Heterogeneous Coded Distributed Computing: Joint Design of File Allocation and Function Assignment
    Xu, Fan
    Tao, Meixia
    2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [29] Data Consistency Protocol for Distributed File Systems
    No, Jaechun
    2009 IEEE INTERNATIONAL WORKSHOP ON INTELLIGENT DATA ACQUISITION AND ADVANCED COMPUTING SYSTEMS: TECHNOLOGY AND APPLICATIONS, 2009, : 253 - 258
  • [30] Application and user-specific data prefetching and parallel read algorithms for distributed file systems
    Nalajala, Anusha
    Ragunathan, T.
    Naha, Ranesh
    Battula, Sudheer Kumar
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (03): : 3593 - 3613