Provision additional throughput for your agent's model

Note

Amazon Bedrock Agents (now Amazon Bedrock Agents Classic) is no longer open to new customers. For capabilities similar to Bedrock Agents Classic, explore Amazon Bedrock AgentCore. Existing customers can continue to use the service as normal. For more information, see Amazon Bedrock Agents Classic maintenance mode.

To increase the rate and number of tokens that the agent can process during model inference, associate a Provisioned Throughput that you've purchased for the model that your agent is using. To learn more about Provisioned Throughput and how to purchase it, see Increase model invocation capacity with Provisioned Throughput in Amazon Bedrock.

You can associate a Provisioned Throughput when you create or update an agent alias. In the Amazon Bedrock console, you choose the Provisioned Throughput when setting up the alias or editing it. In the Amazon Bedrock API, you specify the provisionedThroughput in the routingConfiguration when you send a CreateAgentAlias or UpdateAgentAlias; request.