Group-based parallel multi-scheduler for grid computing

Abraham, GT, James, A ORCID: https://orcid.org/0000-0001-9274-7803 and Yaacob, N, 2015. Group-based parallel multi-scheduler for grid computing. Future Generation Computer Systems, 50, pp. 140-153. ISSN 0167-739X

Preview

Text PubSub10284_James.pdf - Post-print Download (1MB) | Preview

Abstract

With the advent in multicore computers, the scheduling of Grid jobs can be made more effective if scaled to fully utilize the underlying hardware, and parallelized to benefit from the exploitation of multicores. The fact that sequential algorithms do not scale with multicore systems nor benefit from parallelism remains a major obstacle to scheduling in the Grid. As multicore systems become ever more pervasive in our computing lives, over reliance on such systems for passive parallelism does not offer the best option in harnessing the benefits of their multiprocessors for Grid scheduling. An explicit means of exploiting parallelism for Grid scheduling is required. The Group-based Parallel Multi-scheduler, introduced in this paper, is aimed at effectively exploiting the benefits of multicore systems for Grid scheduling by splitting jobs and machines into paired groups and independently scheduling jobs in parallel from those groups. We implemented two job grouping methods, Execution Time Balanced (ETB) and Execution Time Sorted then Balanced (ETSB), and two machine grouping methods, Evenly Distributed (EvenDist) and Similar Together (SimTog). For each method, we varied the number of groups between 2, 4 and 8. We then executed the MinMin Grid scheduling algorithm independently within the groups. We demonstrated that by sharing jobs and machines into groups before scheduling, the computation time for the scheduling process drastically improved by magnitudes of 85% over the ordinary MinMin algorithm when implemented on a HPC system. We also found that our balanced group based approach achieved better results than our previous Priority based grouping approach.

Item Type:	Journal article
Publication Title:	Future Generation Computer Systems
Creators:	Abraham, G.T., James, A. and Yaacob, N.
Publisher:	Elsevier
Date:	September 2015
Volume:	50
ISSN:	0167-739X
Identifiers:	Number Type 10.1016/j.future.2015.01.012 DOI S0167739X15000291 Publisher Item Identifier
Divisions:	Schools > School of Science and Technology
Record created by:	Linda Sullivan
Date Added:	21 Feb 2018 11:34
Last Modified:	21 Feb 2018 11:34
URI:	https://irep.ntu.ac.uk/id/eprint/32776

Actions (login required)

Edit View

Statistics

Views

Downloads