Class: Aws::SageMaker::Types::CrossRegionTrafficConfig

Inherits:
Struct
  • Object
show all
Defined in:
gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb

Overview

The cross-Region traffic cap for an endpoint. The cap limits the requests per second that the endpoint accepts from inference routers in other Amazon Web Services Regions. The cap is MaxCrossRegionPercentPerEndpoint percent of MaxInvocationsPerSecondPerInstance multiplied by the number of InService instances, rounded up. All production variants and inference components of the endpoint share it. Requests that you send to the endpoint directly aren't counted. A request over the cap fails with a ThrottlingException.

Constant Summary collapse

SENSITIVE =
[]

Instance Attribute Summary collapse

Instance Attribute Details

#max_cross_region_percent_per_endpoint ⇒ Integer

The percentage of the endpoint's capacity that requests from inference routers in other Amazon Web Services Regions can use.

Returns:

  • (Integer)


15868
15869
15870
15871
15872
15873
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 15868

class CrossRegionTrafficConfig < Struct.new(
  :max_invocations_per_second_per_instance,
  :max_cross_region_percent_per_endpoint)
  SENSITIVE = []
  include Aws::Structure
end

#max_invocations_per_second_per_instance ⇒ Integer

The number of invocations per second that you expect one InService instance to serve. One value applies to every production variant, whatever its instance type.

Returns:

  • (Integer)


15868
15869
15870
15871
15872
15873
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 15868

class CrossRegionTrafficConfig < Struct.new(
  :max_invocations_per_second_per_instance,
  :max_cross_region_percent_per_endpoint)
  SENSITIVE = []
  include Aws::Structure
end