Posted On: Mar 21, 2017
HAQM EMR now supports a variety of new HAQM EC2 Spot instance management features with instance fleets. Instead of specifying a specific HAQM EC2 instance type for an HAQM EMR instance group or HAQM EC2 availability zone for your HAQM EMR cluster, you can now provide a list of possible choices and allow HAQM EMR to automatically select an optimal combination. When creating clusters with instance fleets, HAQM EMR can now automatically provision Spot capacity across a variety of instance types, select optimal HAQM EC2 availability zones, and blend Spot and On-Demand capacity to minimize overall cost.
When creating an HAQM EMR cluster with instance fleets, you provide the target Spot and On-Demand HAQM EC2 capacity for your cluster and a list of possible instance types and related Spot bid prices to choose from. Next, HAQM EMR will automatically provision Spot and On-Demand capacity across your specified instance types to reach your target capacity. Additionally, HAQM EMR instance fleets support Spot blocks, or Spot instances for predefined durations, which allow you to execute without interruption for 1 to 6 hours.
You can create HAQM EMR clusters with instance fleets from the HAQM EMR console, AWS Command Line Interface (CLI), or the AWS SDK with the HAQM EMR API. Instance fleets are supported on HAQM EMR release 5.1.0 or later and 4.8.0 or later. When using instance fleets, you can specify a list of possible VPC subnets or HAQM EC2 Availability Zones where HAQM EMR can launch your cluster. Please visit the HAQM EMR documentation for more information about instance fleets.