Supported region and models for Provisioned Throughput
Provisioned Throughput is supported in the following regions:
Region |
---|
US East (N. Virginia) |
US West (Oregon) |
Asia Pacific (Mumbai) |
Asia Pacific (Sydney) |
Canada (Central) |
Europe (London) |
Europe (Paris) |
Europe (Ireland) |
South America (São Paulo) |
AWS GovCloud (US-West) |
AWS GovCloud (US-West) (only for custom models with no commitment) |
If you purchase Provisioned Throughput through the Amazon Bedrock API, you must specify a contextual variant of Amazon Bedrock FMs for the model ID. The following table shows the models for which you can purchase Provisioned Throughput, whether you can purchase without commitment for the base model, and the model ID to use when purchasing Provisioned Throughput.
Model name | No-commitment purchase supported for base model | Model ID for Provisioned Throughput |
---|---|---|
Amazon Titan Text G1 - Express | Yes | amazon.titan-text-express-v1:0:8k |
Amazon Titan Text G1 - Lite | Yes | amazon.titan-text-lite-v1:0:4k |
Amazon Titan Text Premier (preview) | Yes | amazon.titan-text-premier-v1:0:32K |
Amazon Titan Embeddings G1 - Text | Yes | amazon.titan-embed-text-v1:2:8k |
Amazon Titan Embeddings G1 - Text v2 | Yes | amazon.titan-embed-text-v2:0:8k |
Amazon Titan Multimodal Embeddings G1 | Yes | amazon.titan-embed-image-v1:0 |
Amazon Titan Image Generator G1 | No | amazon.titan-image-generator-v1:0 |
Anthropic Claude v2 18K | Yes | anthropic.claude-v2:0:18k |
Anthropic Claude v2 100K | Yes | anthropic.claude-v2:0:100k |
Anthropic Claude v2.1 18K | Yes | anthropic.claude-v2:1:18k |
Anthropic Claude v2.1 200K | Yes | anthropic.claude-v2:1:200k |
Anthropic Claude 3 Sonnet 28K | Yes | anthropic.claude-3-sonnet-20240229-v1:0:28k |
Anthropic Claude 3 Sonnet 200K | Yes | anthropic.claude-3-sonnet-20240229-v1:0:200k |
Anthropic Claude 3 Haiku 48K | Yes | anthropic.claude-3-haiku-20240307-v1:0:48k |
Anthropic Claude 3 Haiku 200K | Yes | anthropic.claude-3-haiku-20240307-v1:0:200k |
Anthropic Claude Instant v1 100K | Yes | anthropic.claude-instant-v1:2:100k |
AI21 Labs Jurassic-2 Ultra | Yes | ai21.j2-ultra-v1:0:8k |
Cohere Command | Yes | cohere.command-text-v14:7:4k |
Cohere Command Light | Yes | cohere.command-light-text-v14:7:4k |
Cohere Embed English | Yes | cohere.embed-english-v3:0:512 |
Cohere Embed Multilingual | Yes | cohere.embed-multilingual-v3:0:512 |
Stable Diffusion XL 1.0 | No | stability.stable-diffusion-xl-v1:0 |
Meta Llama 2 Chat 13B | No | meta.llama2-13b-chat-v1:0:4k |
Meta Llama 2 13B | No | (see note below) |
Meta Llama 2 70B | No | (see note below) |
Note
The Meta Llama 2 (non-chat) models can only be used after being customized and after purchasing Provisioned Throughput for them.
To learn about the features in Amazon Bedrock that you can use Provisioned Throughput with, see Use a Provisioned Throughput.