Advances in Topology-Aware Scheduling in Multidimensional Torus-Based Systems

Communication networks in recent high performance computing machines often have multi-dimensional torus topologies, which influences the way jobs should be scheduled into the system. With the rapid growth of the size of modern HPC system's interconnect, network contention has become a critical issue for the performance of parallel jobs, especially for those which are communicationintensive and not tolerant to inter-job interference. Moreover, to improve the runtime consistency, a contiguous allocation strategy is usually adopted, and each job is allocated a convex prism. However, using this strategy brings in internal and external fragmentation, which can degrade the system utilization. To this end, in this work, we investigate and develop various strategies in topology-aware job scheduling strategies for multidimensional torus-based systems, with the objective of improving job performance and system utilization.