Class: Aws::SageMaker::Types::CrossRegionTrafficConfig
- Inherits:
-
Struct
- Object
- Struct
- Aws::SageMaker::Types::CrossRegionTrafficConfig
- Defined in:
- gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb
Overview
The cross-Region traffic cap for an endpoint. The cap limits the
requests per second that the endpoint accepts from inference routers
in other Amazon Web Services Regions. The cap is
MaxCrossRegionPercentPerEndpoint percent of
MaxInvocationsPerSecondPerInstance multiplied by the number of
InService instances, rounded up. All production variants and
inference components of the endpoint share it. Requests that you send
to the endpoint directly aren't counted. A request over the cap fails
with a ThrottlingException.
Constant Summary collapse
- SENSITIVE =
[]
Instance Attribute Summary collapse
-
#max_cross_region_percent_per_endpoint ⇒ Integer
The percentage of the endpoint's capacity that requests from inference routers in other Amazon Web Services Regions can use.
-
#max_invocations_per_second_per_instance ⇒ Integer
The number of invocations per second that you expect one
InServiceinstance to serve.
Instance Attribute Details
#max_cross_region_percent_per_endpoint ⇒ Integer
The percentage of the endpoint's capacity that requests from inference routers in other Amazon Web Services Regions can use.
15868 15869 15870 15871 15872 15873 |
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 15868 class CrossRegionTrafficConfig < Struct.new( :max_invocations_per_second_per_instance, :max_cross_region_percent_per_endpoint) SENSITIVE = [] include Aws::Structure end |
#max_invocations_per_second_per_instance ⇒ Integer
The number of invocations per second that you expect one InService
instance to serve. One value applies to every production variant,
whatever its instance type.
15868 15869 15870 15871 15872 15873 |
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 15868 class CrossRegionTrafficConfig < Struct.new( :max_invocations_per_second_per_instance, :max_cross_region_percent_per_endpoint) SENSITIVE = [] include Aws::Structure end |