Optimizing resource utilization for large scale problems through architecture aware scheduling

被引:0
|
作者
Elsawwaf, Ali M. [1 ]
Aly, Gamal M. [1 ]
Faheem, Hossam M. [2 ]
Fayez, Mahmoud [2 ]
机构
[1] Ain Shams Univ, Fac Engn, Comp & Syst Engn Dept, Cairo, Egypt
[2] Ain Shams Univ, Fac Comp & Informat Sci, Comp Syst Dept, Cairo, Egypt
来源
SCIENTIFIC REPORTS | 2024年 / 14卷 / 01期
关键词
Parallel Processing; High performance computing; Task Scheduling;
D O I
10.1038/s41598-024-75711-8
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Rapid development realms of parallel architectures and its heterogeneity have inspired researchers to invent new scheduling strategies to efficiently distribute workloads among these architectures in a way that may lead to better performance. This paper presents a comprehensive study on optimizing resource utilization for large-scale problems by employing architecture-aware scheduling techniques. We conducted a series of experiments to measure the execution times of various architectures with different problem sizes. These experiments have been conducted multiple times to minimize measurement variance. The findings from these experiments are utilized to develop a scheduling strategy that enables faster completion of larger data-parallel problems while maximizing resource utilization. The proposed approach makes performance enhancement with 16.7% for large data size. It has a significant impact on enhancing computational efficiency and reducing costs in high-performance computing environments.
引用
收藏
页数:18
相关论文
共 50 条
  • [21] Improved and competitive algorithms for large scale multiple resource-constrained project-scheduling problems
    Mohammad Rostami
    Dariush Moradinezhad
    Azadeh Soufipour
    KSCE Journal of Civil Engineering, 2014, 18 : 1261 - 1269
  • [22] Improved and competitive algorithms for large scale multiple resource-constrained project-scheduling problems
    Rostami, Mohammad
    Moradinezhad, Dariush
    Soufipour, Azadeh
    KSCE JOURNAL OF CIVIL ENGINEERING, 2014, 18 (05) : 1261 - 1269
  • [23] Enforcing Quality of Service Through Hardware Resource Aware Process Scheduling
    Jagemar, Marcus
    Ermedahl, Andreas
    Eldh, Sigrid
    Behnam, Moris
    Lisper, Bjorn
    2018 IEEE 23RD INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2018, : 329 - 336
  • [24] SOLVING LARGE-SCALE TOUR SCHEDULING PROBLEMS
    JARRAH, AIZ
    BARD, JF
    DESILVA, AH
    MANAGEMENT SCIENCE, 1994, 40 (09) : 1124 - 1144
  • [25] Solving large scale crew scheduling problems in practice
    Abbink E.J.W.
    Albino L.
    Dollevoet T.
    Huisman D.
    Roussado J.
    Saldanha R.L.
    Public Transport, 2011, 3 (2) : 149 - 164
  • [26] Distributed constraints for large-scale scheduling problems
    Abril, M
    Salido, MA
    Barber, F
    PRINCIPLES AND PRACTICE OF CONSTRAINT PROGRAMMING - CP 2005, PROCEEDINGS, 2005, 3709 : 837 - 837
  • [27] A Review of Resource Scheduling in Large-Scale Server Cluster
    He, Libo
    Qiang, Zhenping
    Zhou, Wei
    Yao, Shaowen
    KNOWLEDGE MANAGEMENT IN ORGANIZATIONS (KMO 2017), 2017, 731 : 494 - 505
  • [28] The Model Design of Mobile Resource Scheduling in Large Scale Activities
    Cai-Qiu Zhou
    Yu-Wang Yang
    Bei Gong
    Meng-Kun Li
    Jin Li
    Ren-Qiang Wen
    Mobile Networks and Applications, 2018, 23 : 382 - 394
  • [29] The Model Design of Mobile Resource Scheduling in Large Scale Activities
    Zhou, Cai-Qiu
    Yang, Yu-Wang
    Gong, Bei
    Li, Meng-Kun
    Li, Jin
    Wen, Ren-Qiang
    MOBILE NETWORKS & APPLICATIONS, 2018, 23 (03): : 382 - 394
  • [30] Optimizing project selection and scheduling problems with time-dependent resource constraints
    Liu, Shu-Shun
    Wang, Chang-Jung
    AUTOMATION IN CONSTRUCTION, 2011, 20 (08) : 1110 - 1119