A hypergraph partitioning based approach for scheduling of tasks with batch-shared I/O

被引：0

作者：

Khanna, G ^{[1
]}

Vydyanathan, N ^{[1
]}

Kurc, T ^{[1
]}

Catalyurek, U ^{[1
]}

Wyckoff, P ^{[1
]}

Saltz, J ^{[1
]}

Sadayappan, P ^{[1
]}

机构：

[1] Ohio State Univ, Dept Comp Sci & Engn, Columbus, OH 43210 USA

来源：

2005 IEEE INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID, VOLS 1 AND 2 | 2005年

关键词：

D O I：

暂无

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

This paperproposes a novel, hypergraph partitioning based strategy to schedule multiple data analysis tasks with batch-shared I/O behavior. This strategy formulates the sharing of files among tasks as a hypergraph to minimize the I/O overheads due to transferring of the same set of files multiple times and employs a dynamic scheme for file transfers to reduce contention on the storage system. We experimentally evaluate the proposed approach using application emulators from two application domains; analysis of remotely-sensed data and biomedical imaging.

引用

页码：792 / 799

页数：8

共 50 条

[21] Scheduling and performance prediction of I/O intensive tasks in parallel time-sharing systems
Drews, F
[J]. PDPTA'2001: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED PROCESSING TECHNIQUES AND APPLICATIONS, 2001, : 2159 - 2164
[22] An Adaptive Approach for Solving Dynamic Scheduling with Time-varying Number of Tasks - Part I
Abello, Manuel Blanco
Lam Thu Bui
Michalewicz, Zbignew
[J]. 2011 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2011, : 1703 - 1710
[23] An extension to DAG based scheduling for partial dependent tasks An Approach to optimize partial dependent tasks in a Distributed system
Shweta, M. A.
Eeratta, Raghavendra
Shenoy, Sanath. S.
[J]. 2012 ANNUAL IEEE INDIA CONFERENCE (INDICON), 2012, : 193 - 197
[24] I/O Scheduling Schemes for Better I/O Proportionality on Flash-based SSDs
Kim, Jaeho
Lee, Eunjae
Noh, Sam H.
[J]. 2016 IEEE 24TH INTERNATIONAL SYMPOSIUM ON MODELING, ANALYSIS AND SIMULATION OF COMPUTER AND TELECOMMUNICATION SYSTEMS (MASCOTS), 2016, : 221 - 230
[25] Shared-Resource-Centric Limited Preemptive Scheduling: A Comprehensive Study of Suspension-based Partitioning Approaches
Dong, Zheng
Liu, Cong
Bateni, Soroush
Chen, Kuan-Hsun
Chen, Jian-Jia
von der Brueggen, Georg
Shi, Junjie
[J]. 24TH IEEE REAL-TIME AND EMBEDDED TECHNOLOGY AND APPLICATIONS SYMPOSIUM (RTAS 2018), 2018, : 164 - 176
[26] Research and Design of Shared Resources Competition Solution among Hardware-Software Tasks based on Unified Scheduling
Guo, Bing
Shen, Yan
Zhang, Lei
Zhou, Xiang
[J]. EUC 2008: PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON EMBEDDED AND UBIQUITOUS COMPUTING, VOL 2, WORKSHOPS, 2008, : 467 - +
[27] An insight-based approach for batch water network with flexible production scheduling framework
Huang, Tianyue
Zhou, Weihao
Zhang, Yanmei
Jia, Xiaoping
Zhang, Dawei
Li, Zhiwei
[J]. JOURNAL OF CLEANER PRODUCTION, 2023, 385
[28] Scheduling of multistage multiproduct chemical batch plants using a constraint-based approach
Huang, W
Chung, PWH
[J]. COMPUTERS & CHEMICAL ENGINEERING, 1999, 23 : S511 - S514
[29] Delay-based I/O request scheduling in SSDs
Chen, Renhai
Guan, Qiming
Ma, Chenlin
Feng, Zhiyong
[J]. JOURNAL OF SYSTEMS ARCHITECTURE, 2019, 98 : 434 - 442
[30] Online Dispatching and Fair Scheduling of Edge Computing Tasks: A Learning-Based Approach
Yuan, Hao
Tang, Guoming
Li, Xinyi
Guo, Deke
Luo, Lailong
Luo, Xueshan
[J]. IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (19): : 14985 - 14998

← 1 2 3 4 5 →