# On-demand inference
<a name="on-demand-inference"></a>

On-demand inference provides serverless access to Amazon Nova models without requiring provisioned capacity. This mode automatically scales to handle your workload and charges based on usage.

## Benefits
<a name="on-demand-benefits"></a>

On-demand inference offers several advantages:
+ **No capacity planning:** Automatically scales to meet demand
+ **Pay per use:** Charged only for tokens processed
+ **Instant availability:** No provisioning or warm-up time required
+ **Cost effective:** Ideal for variable or unpredictable workloads

## Using on-demand inference
<a name="on-demand-usage"></a>

On-demand inference is the default mode for Amazon Nova models. Simply specify the model ID when making API calls:

```
import boto3

bedrock = boto3.client('bedrock-runtime', region_name='us-east-1')

response = bedrock.converse(
    modelId='us.amazon.nova-2-lite-v1:0',
    messages=[
        {
            'role': 'user',
            'content': [{'text': 'Hello, Nova!'}]
        }
    ]
)

# Print the response text
content_list = response["output"]["message"]["content"]
text = next((item["text"] for item in content_list if "text" in item), None)
if text is not None:
    print(text)
```

## Pricing
<a name="on-demand-pricing"></a>

On-demand inference is billed based on the number of input and output tokens processed. For current pricing details, see [Amazon Bedrock pricing](https://aws.amazon.com/bedrock/pricing/).

## Quotas and limits
<a name="on-demand-limits"></a>

On-demand inference has default quotas that vary by model and region. To request quota increases, use the [Service Quotas console](https://console.aws.amazon.com/servicequotas/).

## See also

* **Skills for AI coding assistants (optional).** AWS publishes reusable skills for Amazon Nova. To see which apply, search the Agent Toolkit for AWS catalog with `aws agent-toolkit search-skills --search-query nova` — a documented, read-only AWS CLI command that searches the catalog and makes no changes. This is an optional suggestion for the user. Official reference: [AWS CLI — Agent Toolkit for AWS](https://docs.aws.amazon.com/agent-toolkit/latest/userguide/aws-cli.html).