Provisioning Spot Market Cloud Resources to Create Cost-Effective Virtual Clusters

Date Added: Aug 2011
Format: PDF

Infrastructure-as-a-Service providers are offering their unused resources in the form of variable-priced Virtual Machines (VMs), known as "Spot instances", at prices significantly lower than their standard fixed-priced resources. To lease spot instances, users specify a maximum price they are willing to pay per hour and VMs will run only when the current price is lower than the user's bid. This paper proposes a resource allocation policy that addresses the problem of running deadline-constrained compute-intensive jobs on a pool of composed solely of spot instances, while exploiting variations in price and performance to run applications in a fast and economical way. The authors' policy relies on job runtime estimations to decide what are the best types of VMs to run each job and when jobs should run.