Use a custom model

Before you can use a customized model, you need to purchase Provisioned Throughput for it. For more information about Provisioned Throughput, see Provisioned Throughput for Amazon Bedrock. You can then use the resulting provisioned model for inference. Select the tab corresponding to your method of choice and follow the steps.

Console

To purchase Provisioned Throughput for a custom model.

1. In the Amazon Bedrock console, choose Custom models under Foundation models from the left navigation pane.

2. In the Models tab, choose the radio button next to the model for which you want to buy Provisioned Throughput or select the model name to navigate to the details page.

3. Select Purchase Provisioned Throughput.

4. For more details, follow the steps at Purchase a Provisioned Throughput for a Amazon Bedrock model.

5. After purchasing Provisioned Throughput for your custom model, follow the steps at Use a Provisioned Throughput.

When you carry out any operation that supports usage of custom models, you will see your custom model as an option in the model selection menu.

API

To purchase Provisioned Throughput for a custom model, follow the steps at Purchase a Provisioned Throughput for a Amazon Bedrock model to send a CreateProvisionedModelThroughput (see link for request and response formats and field details) request with a Amazon Bedrock control plane endpoint. Use the name or ARN of your custom model as the modelId. The response returns a provisionedModelArn that you can use as the modelId when making an InvokeModel or InvokeModelWithResponseStream request.

See code examples