Prompt management in Amazon Bedrock

Note

Prompt management is in preview and is subject to change.

Amazon Bedrock provides you the ability to create and save your own prompts using Prompt management so that you can save time by applying the same prompt to different workflows. When you create your a prompt, you can select a model to run inference on it and modify the inference parameters to use. You can include variables in the prompt so that you can adjust the prompt for different use case.

When you test your prompt, you have the option of comparing different variants of the prompt and choosing the variant that yields outputs that are best-suited for your use case. While iterating on your prompt, you can save versions of it. You integrate a prompt into your application with the help of Prompt flows.

The following is the general workflow for using Prompt management:

1. Create a prompt in Prompt management that you want to reuse across different use cases. Include variables to provide flexibility in the model prompt.

2. Choose a model to run inference on the prompt and modify the inference configurations as necessary.

3. Fill in test values for the variables and run the prompt. You can create variants of your prompt and compare the outputs of different variants to choose the best one for your use case.

Topics

• Key definitions
• Supported regions and models for Prompt management
• Create a prompt using Prompt management
• Test a prompt using Prompt management
• Manage prompts using Prompt management
• Deploy prompts using Prompt management by creating versions
• Run Prompt management code samples

Key definitions

The following list introduces you to the basic concepts of Prompt management:

• Prompt – An input provided to a model to guide it to generate an appropriate response or output.

• Variable – A placeholder that you can include in the prompt. You can include values for each variable when testing the prompt or when you at runtime.

• Prompt variant – An alternative configuration of the prompt, including its message or the model or inference configurations used. You can create different variants of a prompt, test them, and save the variant that you want to keep.

• Prompt builder – A tool in the Amazon Bedrock console that lets you create, edit, and test prompts and their variants in a visual interface.