Implementation of a dynamic adjustment strategy for parallel file transfer in co-allocation data grids

被引:0
|
作者
Chao-Tung Yang
Shih-Yu Wang
William Cheng-Chung Chu
机构
[1] Tunghai University,Department of Computer Science
[2] Industrial Technology Research Institute,Communication System Division Service
来源
关键词
Data grid; File replica; Parallel file transfer; Co-allocation; Dynamic adjustment;
D O I
暂无
中图分类号
学科分类号
摘要
Co-allocation architecture was developed to enable parallel transferring of files from multiple replicas stored in the different servers. Several co-allocation strategies have been coupled and used to exploit the different transfer rates among various client-server links and to address dynamic rate fluctuations by dividing files into multiple blocks of equal sizes. The paper presents a dynamic file transfer scheme, called dynamic adjustment strategy (DAS), for co-allocation architecture in concurrently transferring a file from multiple replicas stored in multiple servers within a data grid. The scheme overcomes the obstacle of transfer performance due to idle waiting time of faster servers in co-allocation based file transfers and, therefore, provides reduced file transfer time. A tool with user friendly interface that can be used to manage replicas and downloading in a data grid environment is also described. Experimental results show that our DAS can obtain high-performance file transfer speed and reduce the time cost of reassembling data blocks.
引用
收藏
页码:180 / 205
页数:25
相关论文
共 50 条
  • [1] Implementation of a dynamic adjustment strategy for parallel file transfer in co-allocation data grids
    Yang, Chao-Tung
    Wang, Shih-Yu
    Chu, William Cheng-Chung
    [J]. JOURNAL OF SUPERCOMPUTING, 2010, 54 (02): : 180 - 205
  • [2] Implementation of a medical image file accessing system in co-allocation data grids
    Yang, Chao-Tung
    Chen, Chiu-Hsiung
    Yang, Ming-Feng
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2010, 26 (08): : 1127 - 1140
  • [3] A dynamic adjustment strategy for file transformation in data grids
    Yang, Chao-Tung
    Wang, Shih-Yu
    Fu, Chun-Pin
    [J]. NETWORK AND PARALLEL COMPUTING, PROCEEDINGS, 2007, 4672 : 61 - +
  • [4] MIFAS: Medical Image File Accessing System in Co-allocation Data Grids
    Yang, Chao-Tung
    Chen, Chiu-Hsiung
    Yang, Ming-Feng
    Chiang, Wen-Chung
    [J]. 2008 IEEE ASIA-PACIFIC SERVICES COMPUTING CONFERENCE, VOLS 1-3, PROCEEDINGS, 2008, : 769 - +
  • [5] Resource co-allocation for parallel tasks in computational grids
    Wang, LZ
    Cai, WT
    Lee, BS
    [J]. PROCEEDINGS OF THE INTERNATIONAL WORKSHOP ON CHALLENGES OF LARGE APPLICATIONS IN DISTRIBUTED ENVIRONMENTS, 2003, : 88 - 95
  • [6] Memory-mapped File Approach for On-demand Data Co-allocation on Grids
    Chen, Po-Cheng
    Chang, Jyh-Biau
    Zhuang, Yi-Chang
    Shieh, Ce-Kuen
    Liang, Tyng-Yeu
    [J]. CCGRID: 2009 9TH IEEE INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID, 2009, : 300 - +
  • [7] Replica selection on co-allocation data grids
    Chang, RS
    Wang, CM
    Chen, PH
    [J]. PARALLEL AND DISTRIBUTED PROCESSING AND APPLICATIONS, PROCEEDINGS, 2004, 3358 : 584 - 593
  • [8] Improvements on dynamic adjustment mechanism in co-allocation data grid environments
    Chao-Tung Yang
    I-Hsien Yang
    Kuan-Ching Li
    Shih-Yu Wang
    [J]. The Journal of Supercomputing, 2007, 40 : 269 - 280
  • [9] Improvements on dynamic adjustment mechanism in co-allocation data grid environments
    Yang, Chao-Tung
    Yang, I-Hsien
    Li, Kuan-Ching
    Wang, Shih-Yu
    [J]. JOURNAL OF SUPERCOMPUTING, 2007, 40 (03): : 269 - 280
  • [10] Implementation of a Cyber Transformer for Parallel Download in Co-allocation Data Grid Environments
    Yang, Chao-Tung
    Yang, Ming-Feng
    Chiang, Wen-Chung
    [J]. GCC 2008: SEVENTH INTERNATIONAL CONFERENCE ON GRID AND COOPERATIVE COMPUTING, PROCEEDINGS, 2008, : 242 - +