Bedrock Runtime¶
Client¶
AsyncBedrockRuntimeClient
¶
AsyncBedrockRuntimeClient(config: AsyncBedrockRuntimeConfig | None = None, plugins: list[Plugin] | None = None)
Describes the API operations for running inference using Amazon Bedrock models.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
config
|
AsyncBedrockRuntimeConfig | None
|
Optional configuration for the client. Here you can set things like the endpoint for HTTP services or auth credentials. |
None
|
plugins
|
list[Plugin] | None
|
A list of callables applied once to the client's base configuration. Their changes are inherited by every operation invocation. |
None
|
Operations¶
apply_guardrailconverseconverse_streamcount_tokensget_async_invokeinvoke_guardrail_checksinvoke_modelinvoke_model_with_bidirectional_streaminvoke_model_with_response_streamlist_async_invokesstart_async_invoke
Configuration¶
AsyncBedrockRuntimeConfig
dataclass
¶
Bases: AsyncAwsConfig
Bedrock Runtime configuration (async-resolved).
Attributes¶
auth_scheme_resolver
class-attribute
instance-attribute
¶
An auth scheme resolver that determines the auth scheme for each operation.
auth_schemes
class-attribute
instance-attribute
¶
A map of auth scheme ids to auth schemes.
aws_access_key_id
class-attribute
instance-attribute
¶
aws_access_key_id: str | None = None
The identifier for a secret access key.
aws_credentials_identity_resolver
class-attribute
instance-attribute
¶
aws_credentials_identity_resolver: IdentityResolver[AWSCredentialsIdentity, AWSIdentityProperties] | None = None
Resolves AWS Credentials. Required for operations that use Sigv4 Auth.
aws_secret_access_key
class-attribute
instance-attribute
¶
aws_secret_access_key: str | None = None
A secret access key that can be used to sign requests.
aws_session_token
class-attribute
instance-attribute
¶
aws_session_token: str | None = None
The session token used with temporary AWS credentials.
endpoint_resolver
class-attribute
instance-attribute
¶
The endpoint resolver used to resolve the final endpoint per-operation based on the configuration.
interceptors
class-attribute
instance-attribute
¶
The list of interceptors, which are hooks that are called during the execution of a request.
protocol
class-attribute
instance-attribute
¶
The protocol to serialize and deserialize requests with.
region
class-attribute
instance-attribute
¶
region: str | None = None
The AWS region to connect to. The configured region is used to determine the service endpoint.
sdk_ua_app_id
class-attribute
instance-attribute
¶
sdk_ua_app_id: str | None = None
A unique and opaque application ID that is appended to the User-Agent header.
user_agent_extra
class-attribute
instance-attribute
¶
user_agent_extra: str | None = None
Additional suffix to be added to the User-Agent header.
Methods:¶
resolve
async
classmethod
¶
resolve(*, profile: str | None = None, fs: FileSystem | None = None, config_file_path: str | None = None, credentials_file_path: str | None = None, **overrides: Unpack[_AsyncBedrockRuntimeConfigOverrides]) -> Self
Resolve config from environment, config files, defaults, and explicit overrides.
Plugin
module-attribute
¶
Plugin: TypeAlias = Callable[[AsyncBedrockRuntimeConfig], None]
A callable that customizes a client configuration. Service-level plugins are applied once to the base configuration inherited by every operation. Operation-level plugins apply only to a single operation invocation.
Structures¶
AnyToolChoiceAppliedGuardrailDetailsAsyncInvokeS3OutputDataConfigAsyncInvokeSummaryAudioBlockAutoToolChoiceBidirectionalInputPayloadPartBidirectionalOutputPayloadPartCacheDetailCachePointBlockCitationCitationSourceContentDeltaCitationsConfigCitationsContentBlockCitationsDeltaContentBlockDeltaEventContentBlockStartEventContentBlockStopEventConverseMetricsConverseStreamMetadataEventConverseStreamMetricsConverseStreamTraceConverseTokensRequestConverseTraceDocumentBlockDocumentCharLocationDocumentChunkLocationDocumentPageLocationErrorBlockGuardrailAssessmentGuardrailAutomatedReasoningImpossibleFindingGuardrailAutomatedReasoningInputTextReferenceGuardrailAutomatedReasoningInvalidFindingGuardrailAutomatedReasoningLogicWarningGuardrailAutomatedReasoningNoTranslationsFindingGuardrailAutomatedReasoningPolicyAssessmentGuardrailAutomatedReasoningRuleGuardrailAutomatedReasoningSatisfiableFindingGuardrailAutomatedReasoningScenarioGuardrailAutomatedReasoningStatementGuardrailAutomatedReasoningTooComplexFindingGuardrailAutomatedReasoningTranslationGuardrailAutomatedReasoningTranslationAmbiguousFindingGuardrailAutomatedReasoningTranslationOptionGuardrailAutomatedReasoningValidFindingGuardrailChecksConfigGuardrailChecksContentFilterCategoryConfigGuardrailChecksContentFilterConfigGuardrailChecksContentFilterResultGuardrailChecksContentFilterResultEntryGuardrailChecksContentFilterUsageGuardrailChecksMessageGuardrailChecksPromptAttackCategoryConfigGuardrailChecksPromptAttackConfigGuardrailChecksPromptAttackResultGuardrailChecksPromptAttackResultEntryGuardrailChecksPromptAttackUsageGuardrailChecksResultsGuardrailChecksSensitiveInformationConfigGuardrailChecksSensitiveInformationEntityConfigGuardrailChecksSensitiveInformationResultGuardrailChecksSensitiveInformationResultEntryGuardrailChecksSensitiveInformationUsageGuardrailChecksUsageResultsGuardrailConfigurationGuardrailContentFilterGuardrailContentPolicyAssessmentGuardrailContextualGroundingFilterGuardrailContextualGroundingPolicyAssessmentGuardrailConverseImageBlockGuardrailConverseTextBlockGuardrailCoverageGuardrailCustomWordGuardrailImageBlockGuardrailImageCoverageGuardrailInvocationMetricsGuardrailManagedWordGuardrailOutputContentGuardrailPiiEntityFilterGuardrailRegexFilterGuardrailSensitiveInformationPolicyAssessmentGuardrailStreamConfigurationGuardrailTextBlockGuardrailTextCharactersCoverageGuardrailTopicGuardrailTopicPolicyAssessmentGuardrailTraceAssessmentGuardrailUsageGuardrailWordPolicyAssessmentImageBlockImageBlockDeltaImageBlockStartInferenceConfigurationInvokeModelTokensRequestJsonSchemaDefinitionMessageMessageStartEventMessageStopEventOutputConfigOutputFormatPayloadPartPerformanceConfigurationPromptRouterTraceReasoningTextBlockS3LocationSearchResultBlockSearchResultContentBlockSearchResultLocationServiceTierSpecificToolChoiceSystemToolTagTokenUsageToolAdditionBlockToolConfigurationToolReferenceToolRemovalBlockToolResultBlockToolResultBlockStartToolSpecificationToolUseBlockToolUseBlockDeltaToolUseBlockStartVideoBlockWebLocation
Errors¶
AccessDeniedExceptionConflictExceptionInternalServerExceptionModelErrorExceptionModelNotReadyExceptionModelStreamErrorExceptionModelTimeoutExceptionResourceNotFoundExceptionServiceErrorServiceQuotaExceededExceptionServiceUnavailableExceptionThrottlingExceptionValidationException
Unions¶
AsyncInvokeOutputDataConfigAudioSourceCitationGeneratedContentCitationLocationCitationSourceContentContentBlockContentBlockDeltaContentBlockStartConverseOutputConverseStreamOutputCountTokensInputDocumentContentBlockDocumentSourceGuardrailAutomatedReasoningFindingGuardrailChecksContentBlockGuardrailContentBlockGuardrailConverseContentBlockGuardrailConverseImageSourceGuardrailImageSourceImageSourceInvokeModelWithBidirectionalStreamInputInvokeModelWithBidirectionalStreamOutputOutputFormatStructurePromptVariableValuesReasoningContentBlockReasoningContentBlockDeltaResponseStreamSystemContentBlockToolToolChoiceToolInputSchemaToolResultBlockDeltaToolResultContentBlockVideoSource
Enums¶
AsyncInvokeStatusAudioFormatCachePointTypeCacheTTLConversationRoleDocumentFormatGuardrailActionGuardrailAutomatedReasoningLogicWarningTypeGuardrailChecksContentFilterCategoryGuardrailChecksPromptAttackCategoryGuardrailChecksRoleGuardrailChecksSensitiveInformationEntityTypeGuardrailContentFilterConfidenceGuardrailContentFilterStrengthGuardrailContentFilterTypeGuardrailContentPolicyActionGuardrailContentQualifierGuardrailContentSourceGuardrailContextualGroundingFilterTypeGuardrailContextualGroundingPolicyActionGuardrailConverseContentQualifierGuardrailConverseImageFormatGuardrailImageFormatGuardrailManagedWordTypeGuardrailOriginGuardrailOutputScopeGuardrailOwnershipGuardrailPiiEntityTypeGuardrailSensitiveInformationPolicyActionGuardrailStreamProcessingModeGuardrailTopicPolicyActionGuardrailTopicTypeGuardrailTraceGuardrailWordPolicyActionImageFormatOutputFormatTypePerformanceConfigLatencyServiceTierTypeSortAsyncInvocationBySortOrderStopReasonToolResultStatusToolUseTypeTraceVideoFormat