Manage a Provisioned Throughput - Amazon Bedrock
View information about a Provisioned ThroughputEdit a Provisioned ThroughputDelete a Provisioned Throughput

Manage a Provisioned Throughput

After you purchase a Provisioned Throughput you can view details about it, update it, or delete it.

View information about a Provisioned Throughput

To learn how to view information about a Provisioned Throughput that you've purchased, select the tab corresponding to your method of choice and follow the steps.

Console
To view information about a Provisioned Throughput

  1. Sign in to the AWS Management Console using an IAM role with Amazon Bedrock permissions, and open the Amazon Bedrock console at https://console.aws.amazon.com/bedrock/.

  2. Select Provisioned Throughput under Assessment and deployment from the left navigation pane.

  3. From the Provisioned Throughput section, select a Provisioned Throughput.

  4. View the details for the Provisioned Throughput in the Provisioned Throughput overview section and the tags associated with your Provisioned Throughput in the Tags section.

API

To retrieve information about a specific Provisioned Throughput, send a GetProvisionedModelThroughput request (see link for request and response formats and field details) with an Amazon Bedrock control plane endpoint. Specify either the name of the Provisioned Throughput or its ARN as the provisionedModelId.

To list information about all the Provisioned Throughputs in an account, send a ListProvisionedModelThroughputs request (see link for request and response formats and field details) with an Amazon Bedrock control plane endpoint. To control the number of results that are returned, you can specify the following optional parameters:

Field Short description
maxResults The maximum number of results to return in a response.
nextToken If there are more results than the number you specified in the maxResults field, the response returns a nextToken value. To see the next batch of results, send the nextToken value in another request.

For other optional parameters that you can specify to sort and filter the results, see GetProvisionedModelThroughput.

To list all the tags for an agent, send a ListTagsForResource request (see link for request and response formats and field details) with an Amazon Bedrock control plane endpoint and include the Amazon Resource Name (ARN) of the Provisioned Throughput.

See code examples

Edit a Provisioned Throughput

You can edit the name or tags of an existing Provisioned Throughput.

The following restrictions apply to changing the model that the Provisioned Throughput is associated with:

  • You can't change the model for a Provisioned Throughput associated with a base model.

  • If the Provisioned Throughput is associated with a custom model, you can change the association to the base model that it's customized from, or to another custom model that was derived from the same base model.

While a Provisioned Throughput is updating, you can run inference using the Provisioned Throughput without disrupting the on-going traffic from your end customers. If you changed the model that the Provisioned Throughput is associated with, you might receive output from the old model until the update is fully deployed.

To learn how to edit a Provisioned Throughput, select the tab corresponding to your method of choice and follow the steps.

Console

  1. Sign in to the AWS Management Console using an IAM role with Amazon Bedrock permissions, and open the Amazon Bedrock console at https://console.aws.amazon.com/bedrock/.

  2. Select Provisioned Throughput under Assessment and deployment from the left navigation pane.

  3. From the Provisioned Throughput section, select a Provisioned Throughput.

  4. Choose Edit. You can edit the following fields:

    • Provisioned Throughput name – Change the name of the Provisioned Throughput.

    • Select model – If the Provisioned Throughput is associated with a custom model, you can change the associated model.

  5. You can edit the tags associated with your Provisioned Throughput in the Tags section. For more information, see Tag resources.

  6. To save your changes, choose Save edits.

  7. The console displays the Provisioned Throughput overview page. The Status of the Provisioned Throughput in the Provisioned Throughput table becomes Updating. When the Provisioned Throughput is finished being update, the Status becomes In service. If the update fails, the Status becomes Failed.

API

To edit a Provisioned Throughput, send an UpdateProvisionedModelThroughput request (see link for request and response formats and field details) with an Amazon Bedrock control plane endpoint.

The following table briefly describes the parameters and request body (for detailed information and the request structure, see the UpdateProvisionedModelThroughput request syntax):

Variable Required? Use case
provisionedModelId Yes To specify the name or ARN of the Provisioned Throughput to update
desiredModelId No To specify a new model to associate with the Provisioned Throughput (unavailable for Provisioned Throughputs associated with base models).
desiredProvisionedModelName No To specify a new name for the Provisioned Throughput

If the action is successful, the response returns an HTTP 200 status response. To check when the Provisioned Throughput is ready for use, send a GetProvisionedModelThroughput request and check that the status is InService. You can't update or delete a Provisioned Throughput while its status is Updating. If the update fails, its status will be Failed, and the GetProvisionedModelThroughput response will contain a failureMessage.

To add tags to a Provisioned Throughput, send a TagResource request (see link for request and response formats and field details) with an Amazon Bedrock control plane endpoint and include the Amazon Resource Name (ARN) of the Provisioned Throughput. The request body contains a tags field, which is an object containing a key-value pair that you specify for each tag.

To remove tags from a Provisioned Throughput, send an UntagResource request (see link for request and response formats and field details) with an Amazon Bedrock control plane endpoint and include the Amazon Resource Name (ARN) of the Provisioned Throughput. The tagKeys request parameter is a list containing the keys for the tags that you want to remove.

See code examples

Delete a Provisioned Throughput

To learn how to delete a Provisioned Throughput, select the tab corresponding to your method of choice and follow the steps.

Note

You can’t delete a Provisioned Throughput with commitment before the commitment term is complete.

Console

  1. Sign in to the AWS Management Console using an IAM role with Amazon Bedrock permissions, and open the Amazon Bedrock console at https://console.aws.amazon.com/bedrock/.

  2. Select Provisioned Throughput under Assessment and deployment from the left navigation pane.

  3. From the Provisioned Throughput section, select a Provisioned Throughput.

  4. Choose Delete.

  5. The console displays a modal form to warn you that deletion is permanent. Choose Confirm to proceed.

  6. The Provisioned Throughput is immediately deleted.

API

To delete a Provisioned Throughput, send a DeleteProvisionedModelThroughput request (see link for request and response formats and field details) with an Amazon Bedrock control plane endpoint. Specify either the name of the Provisioned Throughput or its ARN as the provisionedModelId. If deletion is successful, the response returns an HTTP 200 status code.

See code examples