Capability-Aware Data Placement for Heterogeneous Active Storage Systems

被引：0

作者：

LI Xiangyu ^{[1
,2
,3
]}

HE Shuibing ^{[1
,2
]}

XU Xianbin ^{[1
]}

WANG Yang ^{[4
]}

机构：

[1] School of Computer, Wuhan University

[2] State Key Laboratory of High Performance Computing,National University of Defense Technology

[3] School of Computer Science, Wuhan Donghu University

[4] Shenzhen Institute of Advanced Technology, Chinese Academy of Science

来源：

Wuhan University Journal of Natural Sciences | 2016年 / 21卷 / 03期

基金：

美国国家科学基金会;

关键词：

active storage; parallel I/O system; CADP; data placement;

D O I：

暂无

中图分类号：

TP333 [存贮器];

学科分类号：

081201 ;

摘要：

By moving computations from computing nodes to storage nodes, active storage technology provides an efficient for data-intensive high-performance computing applications. The existing studies have neglected the heterogeneity of storage nodes on the performance of active storage systems. We introduce CADP, a capability-aware data placement scheme for heterogeneous active storage systems to obtain high-performance data processing. The basic idea of CADP is to place data on storage nodes based on their computing capability and storage capability, so that the load-imbalance among heterogeneous servers can be avoided. We have implemented CADP under a parallel I/O system. The experimental results show that the proposed capability-aware data placement scheme can improve the active storage system performance significantly.

引用

页码：249 / 256

页数：8

共 50 条

[1] ActCap: Accelerating MapReduce on Heterogeneous Clusters with Capability-Aware Data Placement
Wang, Bo
Jiang, Jinlei
Yang, Guangwen
[J]. 2015 IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (INFOCOM), 2015,
[2] Tornado: a capability-aware peer-to-peer storage overlay
Hsiao, HC
King, CT
[J]. JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2004, 64 (06) : 747 - 758
[3] Capability-Aware Energy-Efficient Virtual Machine Scheduling in Heterogeneous Datacenters
Bhuiyan, Mohammad Fozlul Haque
Wang, Chun
[J]. 2014 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), 2014, : 106 - 111
[4] Capability-Aware Trust Evaluation Model in Multi-agent Systems
Tung Doan Nguyen
Bai, Quan
Li, Weihua
[J]. PRICAI 2016: TRENDS IN ARTIFICIAL INTELLIGENCE, 2016, 9810 : 771 - 778
[5] A guideline for data placement in heterogeneous distributed storage systems
Kaneko, Shun
Nakamura, Takaki
Kamei, Hitoshi
Muraoka, Hiroaki
[J]. PROCEEDINGS 2016 5TH IIAI INTERNATIONAL CONGRESS ON ADVANCED APPLIED INFORMATICS IIAI-AAI 2016, 2016, : 942 - 945
[6] A ramp capability-aware scheduling strategy for integrated electricity-gas systems
Zhang, Mingyang
Zhou, Ming
Wu, Zhaoyuan
Yang, Hongji
Li, Gengyin
[J]. ENERGY, 2022, 241
[7] CAPABILITY-AWARE TRAFFIC FLOW MANAGEMENT FOR METROPLEX ENVIRONMENTS
AhmadBeygi, Shervin
Bromberg, Emily
Elliott, Matthew
Lewis, Taryn
Sud, Ved
[J]. 2013 INTEGRATED COMMUNICATIONS, NAVIGATION AND SURVEILLANCE CONFERENCE (ICNS), 2013,
[8] Designing business capability-aware configurable process models
Derguech, Wassim
Bhiri, Sami
Curry, Edward
[J]. INFORMATION SYSTEMS, 2017, 72 : 77 - 94
[9] Optimal Data Placement for Heterogeneous Cache, Memory, and Storage Systems
Zhang, Lei
Karimi, Reza
Ahmad, Irfan
Vigfusson, Ymir
[J]. PROCEEDINGS OF THE ACM ON MEASUREMENT AND ANALYSIS OF COMPUTING SYSTEMS, 2020, 4 (01)
[10] Data Replica Placement Mechanism for Open Heterogeneous Storage Systems
Xu, X.
Yang, C.
Shao, J.
[J]. 8TH INTERNATIONAL CONFERENCE ON AMBIENT SYSTEMS, NETWORKS AND TECHNOLOGIES (ANT-2017) AND THE 7TH INTERNATIONAL CONFERENCE ON SUSTAINABLE ENERGY INFORMATION TECHNOLOGY (SEIT 2017), 2017, 109 : 18 - 25

← 1 2 3 4 5 →