Scaling the Size of Your Auto Scaling Group
Scaling is the ability to increase or decrease the compute capacity of your application. Scaling starts with an event, or scaling action, which instructs Auto Scaling to either launch or terminate EC2 instances.
Auto Scaling provides a number of ways to adjust scaling to best meet the needs of your applications. As a result, it's important that you have a good understanding of your application. You should keep the following considerations in mind:
What role do you want Auto Scaling to play in your application's architecture? It's common to think about Auto Scaling as a way to increase and decrease capacity, but Auto Scaling is also useful for when you want to maintain a steady number of servers.
What cost constraints are important to you? Because Auto Scaling uses EC2 instances, you only pay for the resources you use. Knowing your cost constraints can help you decide when to scale your applications, and by how much.
What metrics are important to your application? CloudWatch supports a number of different metrics that you can use with your Auto Scaling group. We recommend reviewing them to see which of these metrics are the most relevant to your application.
- Scaling Plans
- Multiple Scaling Policies
- Maintaining the Number of Instances in Your Auto Scaling Group
- Manual Scaling
- Scheduled Scaling
- Dynamic Scaling
- Auto Scaling Cooldowns
- Controlling Which Instances Auto Scaling Terminates During Scale In
- Auto Scaling Lifecycle Hooks
- Temporarily Removing Instances from Your Auto Scaling Group
- Suspending and Resuming Auto Scaling Processes
Auto Scaling provides several ways for you to scale your Auto Scaling group.
Maintain current instance levels at all times
You can configure your Auto Scaling group to maintain a minimum or specified number of running instances at all times. To maintain the current instance levels, Auto Scaling performs a periodic health check on running instances within an Auto Scaling group. When Auto Scaling finds an unhealthy instance, it terminates that instance and launches a new one. For information about configuring your Auto Scaling group to maintain the current instance levels, see Maintaining the Number of Instances in Your Auto Scaling Group.
Manual scaling is the most basic way to scale your resources. You only need to specify the change in the maximum, minimum, or desired capacity of your Auto Scaling group. Auto Scaling manages the process of creating or terminating instances to maintain the updated capacity. For more information, see Manual Scaling.
Scale based on a schedule
Sometimes you know exactly when you will need to increase or decrease the number of instances in your group, simply because that need arises on a predictable schedule. Scaling by schedule means that scaling actions are performed automatically as a function of time and date. For more information, see Scheduled Scaling.
Scale based on demand
A more advanced way to scale your resources, scaling by policy, lets you define parameters that control the Auto Scaling process. For example, you can create a policy that calls for enlarging your fleet of EC2 instances whenever the average CPU utilization rate stays above ninety percent for fifteen minutes. This is useful when you can define how you want to scale in response to changing conditions, but you don't know when those conditions will change. You can set up Auto Scaling to respond for you.
Note that you should have two policies, one for scaling in (terminating instances) and one for scaling out (launching instances), for each event to monitor. For example, if you want to scale out when the network bandwidth reaches a certain level, create a policy specifying that Auto Scaling should start a certain number of instances to help with your traffic. But you may also want an accompanying policy to scale in by a certain number when the network bandwidth level goes back down. For more information, see Dynamic Scaling.
Multiple Scaling Policies
An Auto Scaling group can have more than one scaling policy attached to it any given time. In fact, we recommend that each Auto Scaling group has at least two policies: one to scale your architecture out and another to scale your architecture in. You can also combine scaling policies to maximize the performance of an Auto Scaling group.
To illustrate how multiple policies work together, consider an application that uses
an Auto Scaling group and an Amazon SQS queue to send requests to the EC2 instances in that group. To
help ensure the application performs at optimum levels, there are two policies that
control when the Auto Scaling group should scale out. One policy uses the Amazon CloudWatch metric,
CPUUtilization, to detect when an instance is at 90% of capacity. The
other uses the
NumberOfMessagesVisible to detect when the SQS queue is
becoming overwhelmed with messages.
In a production environment, both of these policies would have complementary policies that control when Auto Scaling should scale in the number of EC2 instances.
When you have more than one policy attached to an Auto Scaling group, there's a chance that both policies could instruct Auto
to scale out (or in) at the same time. In our previous example, it's possible that both an EC2 instance could trigger the
CloudWatch alarm for the
CPUUtilization metric, and the SQS queue trigger the alarm for the
When these situations occur, Auto Scaling chooses the policy that has the greatest impact on the Auto Scaling group. For example, suppose that the policy for CPU utilization instructs Auto Scaling to launch 1 instance, while the policy for the SQS queue prompts Auto Scaling to launch 2 instances. If the scale out criteria for both policies are met at the same time, Auto Scaling gives precedence to the SQS queue policy, because it has the greatest impact on the Auto Scaling group. This results in Auto Scaling launching two instances into the group. This precedence applies even when the policies use different criteria for scaling out. For instance, if one policy instructs Auto Scaling to launch 3 instances, and another instructs Auto Scaling to increase capacity by 25 percent, Auto Scaling give precedence to whichever policy has the greatest impact on the group at that time.