ModelConfiguration¶
Structure Class¶
ModelConfiguration
dataclass
¶
Contains the configuration for a model used in an advanced prompt optimization job, including the model ID and inference parameters.
Attributes¶
additional_model_request_fields
class-attribute
instance-attribute
¶
Additional model request fields. Use this to pass model-specific parameters that are not included in the standard inference configuration.
inference_config
class-attribute
instance-attribute
¶
inference_config: InferenceConfiguration | None = None
The inference configuration for the model, including parameters such as maximum tokens, temperature, and top-p.
model_id
instance-attribute
¶
model_id: str
The model to use for optimization. The value depends on the resource that you use:
-
If you use a base model, specify the model ID or its ARN. For a list of model IDs, see Models at a glance in the Amazon Bedrock User Guide.
-
If you use a cross-Region (system-defined) inference profile, specify the inference profile ID or its ARN. For a list of inference profile IDs, see Supported Regions and models for inference profiles in the Amazon Bedrock User Guide.
-
If you use an application inference profile, specify its full ARN, including the account ID and Region.