Supported models and Regions for Amazon Bedrock Model Distillation
The following table shows which models and AWS Regions Amazon Bedrock Model Distillation supports for teacher and student models.
| Model provider | Teacher | Student | Region |
|---|---|---|---|
| Anthropic | Claude 3.5 Sonnet | Claude 3 Haiku | US West (Oregon) |
| Meta | Llama 3.1 405B Instruct | Llama 3.1 70B Instruct | US West (Oregon) |
| Llama 3.1 8B Instruct | US West (Oregon) | ||
| Llama 3.1 70B Instruct | Llama 3.1 8B Instruct | US West (Oregon) | |
| Amazon | Nova Pro | Nova Lite | US East (N. Virginia) |
| Nova Pro | Nova Micro | US East (N. Virginia) |
Note
You have to buy provisioned throughput to be able to do inference from the distilled model.
For Claude and Llama models, the distillation job is run in US West (Oregon). You can either buy provisioned throughput in US West (Oregon) or copy distilled model to another region and then buy provisioned throughput.
For Nova models, you run distillation job in US East (N. Virginia). For inference, you need to buy provisioned throughput in US East (N. Virginia). You cannot copy Nova models to other regions.
