Optimizing resource utilization for large scale problems through architecture aware scheduling

被引:0
|
作者
Elsawwaf, Ali M. [1 ]
Aly, Gamal M. [1 ]
Faheem, Hossam M. [2 ]
Fayez, Mahmoud [2 ]
机构
[1] Ain Shams Univ, Fac Engn, Comp & Syst Engn Dept, Cairo, Egypt
[2] Ain Shams Univ, Fac Comp & Informat Sci, Comp Syst Dept, Cairo, Egypt
来源
SCIENTIFIC REPORTS | 2024年 / 14卷 / 01期
关键词
Parallel Processing; High performance computing; Task Scheduling;
D O I
10.1038/s41598-024-75711-8
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Rapid development realms of parallel architectures and its heterogeneity have inspired researchers to invent new scheduling strategies to efficiently distribute workloads among these architectures in a way that may lead to better performance. This paper presents a comprehensive study on optimizing resource utilization for large-scale problems by employing architecture-aware scheduling techniques. We conducted a series of experiments to measure the execution times of various architectures with different problem sizes. These experiments have been conducted multiple times to minimize measurement variance. The findings from these experiments are utilized to develop a scheduling strategy that enables faster completion of larger data-parallel problems while maximizing resource utilization. The proposed approach makes performance enhancement with 16.7% for large data size. It has a significant impact on enhancing computational efficiency and reducing costs in high-performance computing environments.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] Improving Resource Utilization through Demand Aware Process Scheduling
    Nesterenko, Brandon
    Yi, Qing
    Rao, Jia
    PROCEEDINGS OF THE 47TH INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, 2018,
  • [2] Enhanced GPU Resource Utilization Through Fairness-aware Task Scheduling
    Tarakji, Ayman
    Gladis, Alexander
    Anwar, Tarek
    Leupers, Rainer
    2015 IEEE TRUSTCOM/BIGDATASE/ISPA, VOL 3, 2015, : 45 - 52
  • [3] Autonomous Resource-Aware Scheduling of Large-Scale Media Workflows
    Desmet, Stein
    Volckaert, Bruno
    De Turck, Filip
    MECHANISMS FOR AUTONOMOUS MANAGEMENT OF NETWORKS AND SERVICES, 2010, 6155 : 50 - 64
  • [4] Parallel genetic algorithms for optimizing resource utilization in large-scale construction projects
    Kandil, A
    El-Rayes, K
    JOURNAL OF CONSTRUCTION ENGINEERING AND MANAGEMENT, 2006, 132 (05) : 491 - 498
  • [5] Resource Utilization-aware Scheduling Technique based on Dynamic Cache Refresh Scheme in Large-Scale Cloud Data centers
    Choi, HeeSeok
    Kang, Jihun
    Yu, Heonchang
    Lee, Daewon
    Chung, KwangSik
    PROCEEDINGS 2017 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE AND COMPUTATIONAL INTELLIGENCE (CSCI), 2017, : 1560 - 1565
  • [6] Resource Utilization Aware Job Scheduling to Mitigate Performance Variability
    Nichols, Daniel
    Marathe, Aniruddha
    Shoga, Kathleen
    Gamblin, Todd
    Bhatele, Abhinav
    2022 IEEE 36TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS 2022), 2022, : 335 - 345
  • [7] OPTIMIZING WATER UTILIZATION THROUGH MULTIPLE CROPS SCHEDULING
    HUANG, WY
    LIANG, T
    WU, IP
    TRANSACTIONS OF THE ASAE, 1975, 18 (02): : 293 - 298
  • [8] Resource Scheduling through Resource-Aware Simulation of Emergency Departments
    Shin, Seung Yeob
    Balasubramanian, Hari
    Brun, Yuriy
    Henneman, Philip L.
    Osterweil, Leon J.
    2013 5TH INTERNATIONAL WORKSHOP ON SOFTWARE ENGINEERING IN HEALTH CARE (SEHC), 2013, : 64 - 70
  • [9] Optimizing hydrothermal coordination scheduling for large scale power
    Ahmed, MM
    Ghani, MRA
    Hassan, I
    POWERCON 2002: INTERNATIONAL CONFERENCE ON POWER SYSTEM TECHNOLOGY, VOLS 1-4, PROCEEDINGS, 2002, : 195 - 200
  • [10] Resource-aware distributed scheduling strategies for large-scale computational Cluster/Grid systems
    Viswanathan, Sivakumar
    Veeravalli, Bharadwaj
    Robertazzi, Thomas G.
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2007, 18 (10) : 1450 - 1461