Utility functions for adaptively executing concurrent workflows

Lee, K ORCID: https://orcid.org/0000-0002-2730-9150, Paton, NW, Sakellariou, R and Fernandes, AAA, 2011. Utility functions for adaptively executing concurrent workflows. Concurrency and Computation: Practice and Experience, 23 (6), pp. 646-666. ISSN 1532-0626

Preview

Text 221161_PubSub2778_Lee_K.pdf Download (382kB) | Preview

Abstract

Workflows are widely used in applications that require coordinated use of computational resources. Workflow definition languages typically abstract over some aspects of the way in which a workflow is to be executed, such as the level of parallelism to be used or the physical resources to be deployed. As a result, a workflow management system has responsibility for establishing how best to map tasks within a workflow to the available resources. As workflows are typically run over shared resources, and thus face unpredictable and changing resource capabilities, there may be benefit to be derived from adapting the task-to-resource mapping while a workflow is executing. This paper describes the use of utility functions to express the relative merits of alternative mappings; in essence, a utility function can be used to give a score to a candidate mapping, and the exploration of alternative mappings can be cast as an optimization problem. In this approach, changing the utility function allows adaptations to be carried out with a view to meeting different objectives. The contributions of this paper include: (i) a description of how adaptive workflow execution can be expressed as an optimization problem where the objective of the adaptation is to maximize a utility function; (ii) a description of how the approach has been applied to support adaptive workflow execution in execution environments consisting of multiple resources, such as grids or clouds, in which adaptations are coordinated across multiple workflows; and (iii) an experimental evaluation of the approach with utility measures based on response time and profit using the Pegasus workflow system.

Item Type:	Journal article
Publication Title:	Concurrency and Computation: Practice and Experience
Creators:	Lee, K., Paton, N.W., Sakellariou, R. and Fernandes, A.A.A.
Publisher:	John Wiley & Sons Ltd.
Date:	2011
Volume:	23
Number:	6
ISSN:	1532-0626
Identifiers:	Number Type 10.1002/cpe.1673 DOI
Rights:	Copyright © 2010 John Wiley & Sons, Ltd.
Divisions:	Schools > School of Science and Technology
Record created by:	EPrints Services
Date Added:	09 Oct 2015 10:18
Last Modified:	09 Jun 2017 13:25
URI:	https://irep.ntu.ac.uk/id/eprint/10897

Actions (login required)

Edit View

Statistics

Views

Downloads