Capability-Aware Data Placement for Heterogeneous Active Storage Systems

被引：0
|
作者：
LI Xiangyu [1 ,2 ,3 ]
HE Shuibing [1 ,2 ]
XU Xianbin [1 ]
WANG Yang [4 ]
机构：
[1] School of Computer, Wuhan University
[2] State Key Laboratory of High Performance Computing,National University of Defense Technology
[3] School of Computer Science, Wuhan Donghu University
[4] Shenzhen Institute of Advanced Technology, Chinese Academy of Science
来源：
Wuhan University Journal of Natural Sciences | 2016年 / 21卷 / 03期
基金：
美国国家科学基金会;
关键词：
active storage; parallel I/O system; CADP; data placement;
D O I：
暂无
中图分类号：
TP333 [存贮器];
学科分类号：
081201 ;
摘要：
By moving computations from computing nodes to storage nodes, active storage technology provides an efficient for data-intensive high-performance computing applications. The existing studies have neglected the heterogeneity of storage nodes on the performance of active storage systems. We introduce CADP, a capability-aware data placement scheme for heterogeneous active storage systems to obtain high-performance data processing. The basic idea of CADP is to place data on storage nodes based on their computing capability and storage capability, so that the load-imbalance among heterogeneous servers can be avoided. We have implemented CADP under a parallel I/O system. The experimental results show that the proposed capability-aware data placement scheme can improve the active storage system performance significantly.
引用
收藏
页码：249 / 256
页数：8
相关论文
共 50 条
  • [21] SLA-Aware Multi-Criteria Data Placement in Cloud Storage Systems
    Maghsoudloo, Mohammad
    Rahdari, Arezoo
    Khoshavi, Navid
    [J]. IEEE ACCESS, 2021, 9 : 54369 - 54388
  • [22] Topology-Aware Data Placement Strategy for Fault-Tolerant Storage Systems
    Xia, Junxu
    Guo, Deke
    Luo, Lailong
    Cheng, Geyao
    [J]. IEEE SYSTEMS JOURNAL, 2020, 14 (03): : 4296 - 4307
  • [23] HaDaap: A hotness-aware data placement strategy for improving storage efficiency in heterogeneous Hadoop clusters
    Xiong, Runqun
    Du, Yao
    Jin, Jiahui
    Luo, Junzhou
    [J]. CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2018, 30 (20):
  • [24] Reliability-Aware Data Placement for Heterogeneous Memory Architecture
    Gupta, Manish
    Sridharan, Vilas
    Roberts, David
    Prodromou, Andreas
    Venkat, Ashish
    Tullsen, Dean
    Gupta, Rajesh
    [J]. 2018 24TH IEEE INTERNATIONAL SYMPOSIUM ON HIGH PERFORMANCE COMPUTER ARCHITECTURE (HPCA), 2018, : 583 - 595
  • [25] Storage-aware caching: Revisiting caching for heterogeneous storage systems
    Forney, BC
    Arpaci-Dusseau, AC
    Arpaci-Dusseau, RH
    [J]. USENIX ASSOCIATION PROCEEDINGS OF THE FAST'02 CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, 2002, : 61 - 74
  • [26] Rack Aware Data Placement for Network Consumption in Erasure-Coded Clustered Storage Systems
    Shao, Bilin
    Song, Dan
    Bian, Genqing
    Zhao, Yu
    [J]. INFORMATION, 2018, 9 (07)
  • [27] Capability-Aware Task Allocation and Team Formation Analysis for Cooperative Exploration of Complex Environments
    Ginting, Muhammad Fadhil
    Otsu, Kyohei
    Kochenderfer, Mykel J.
    Agha-mohammadi, Ali-akbar
    [J]. 2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 7145 - 7152
  • [28] Compass: Cost of migration-aware placement in storage systems
    Verma, Akshat
    Sharma, Upendra
    Jain, Rohit
    Daseupta, Koustuv
    [J]. 2007 10TH IFIP/IEEE INTERNATIONAL SYMPOSIUM ON INTEGRATED NETWORK MANAGEMENT (IM 2009), VOLS 1 AND 2, 2007, : 50 - 59
  • [29] Data Migration in Heterogeneous Storage Systems
    Kari, Chadi
    Kim, Yoo-Ah
    Russell, Alexander
    [J]. 31ST INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2011), 2011, : 143 - 150
  • [30] Data Distribution for Heterogeneous Storage Systems
    Zhou, Jiang
    Chen, Yong
    Zheng, Mai
    Wang, Weiping
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2023, 72 (06) : 1747 - 1762
12345