Submit prompts and generate responses with model inference

Inference refers to the process of generating an output from an input provided to a model.

Amazon Bedrock offers a suite of foundation models that you can use to generate outputs of the following modalities. To see modality support by foundation model, refer to Supported foundation models in Amazon Bedrock.

Output modality	Description	Example use cases
Text	Provide text input and generate various types of text	Chat, question-and-answering, brainstorming, summarization, code generation, table creation, data formatting, rewriting
Image	Provide text or input images and generate or modify images	Image generation, image editing, image variation
Video	Provide text or reference images and generate a video	Video generation, image conversion to video
Embeddings	Provide text, images, or both text and images and generate a vector of numeric values that represent the input. The output vector can be compared to other embeddings vectors to determine semantic similarity (for text) or visual similarity (for images).	Text and image search, query, categorization, recommendations, personalization, knowledge base creation

Topics

• Learn about use cases for different model inference methods

• How inference works in Amazon Bedrock

• Influence response generation with inference parameters

• Supported Regions and models for running model inference

• Prerequisites for running model inference

• Generate responses in the console using playgrounds

• Enhance model responses with model reasoning

• Optimize model inference for latency

• Submit prompts and generate responses using the API

• Use a tool to complete an Amazon Bedrock model response

• Use a computer use tool to complete an Amazon Bedrock model response

• Prompt caching for faster model inference