Class: Aws::SageMaker::Types::GlobalInferenceGatewayRoutingWeights

Inherits:
Struct
  • Object
show all
Defined in:
gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb

Overview

The relative weights of the four routing signals, each from 0 to 1. Specify all four weights or none. If you specify them, they must sum to 1.0, within 0.001. If you specify none, the global inference gateway uses default weights.

Constant Summary collapse

SENSITIVE =
[]

Instance Attribute Summary collapse

Instance Attribute Details

#error_rate ⇒ Float

The weight of the recent error rate of the cluster.

Returns:

  • (Float)


30835
30836
30837
30838
30839
30840
30841
30842
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 30835

class GlobalInferenceGatewayRoutingWeights < Struct.new(
  :kv_headroom,
  :queue_depth,
  :region_proximity,
  :error_rate)
  SENSITIVE = []
  include Aws::Structure
end

#kv_headroom ⇒ Float

The weight of the free key-value (KV) cache capacity on the cluster.

Returns:

  • (Float)


30835
30836
30837
30838
30839
30840
30841
30842
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 30835

class GlobalInferenceGatewayRoutingWeights < Struct.new(
  :kv_headroom,
  :queue_depth,
  :region_proximity,
  :error_rate)
  SENSITIVE = []
  include Aws::Structure
end

#queue_depth ⇒ Float

The weight of the number of requests that are waiting on the cluster.

Returns:

  • (Float)


30835
30836
30837
30838
30839
30840
30841
30842
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 30835

class GlobalInferenceGatewayRoutingWeights < Struct.new(
  :kv_headroom,
  :queue_depth,
  :region_proximity,
  :error_rate)
  SENSITIVE = []
  include Aws::Structure
end

#region_proximity ⇒ Float

The weight of how close the cluster is to the caller.

Returns:

  • (Float)


30835
30836
30837
30838
30839
30840
30841
30842
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 30835

class GlobalInferenceGatewayRoutingWeights < Struct.new(
  :kv_headroom,
  :queue_depth,
  :region_proximity,
  :error_rate)
  SENSITIVE = []
  include Aws::Structure
end