Class: Aws::SageMaker::Types::GlobalInferenceGatewayRoutingWeights
- Inherits:
-
Struct
- Object
- Struct
- Aws::SageMaker::Types::GlobalInferenceGatewayRoutingWeights
- Defined in:
- gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb
Overview
The relative weights of the four routing signals, each from 0 to 1. Specify all four weights or none. If you specify them, they must sum to 1.0, within 0.001. If you specify none, the global inference gateway uses default weights.
Constant Summary collapse
- SENSITIVE =
[]
Instance Attribute Summary collapse
-
#error_rate ⇒ Float
The weight of the recent error rate of the cluster.
-
#kv_headroom ⇒ Float
The weight of the free key-value (KV) cache capacity on the cluster.
-
#queue_depth ⇒ Float
The weight of the number of requests that are waiting on the cluster.
-
#region_proximity ⇒ Float
The weight of how close the cluster is to the caller.
Instance Attribute Details
#error_rate ⇒ Float
The weight of the recent error rate of the cluster.
30835 30836 30837 30838 30839 30840 30841 30842 |
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 30835 class GlobalInferenceGatewayRoutingWeights < Struct.new( :kv_headroom, :queue_depth, :region_proximity, :error_rate) SENSITIVE = [] include Aws::Structure end |
#kv_headroom ⇒ Float
The weight of the free key-value (KV) cache capacity on the cluster.
30835 30836 30837 30838 30839 30840 30841 30842 |
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 30835 class GlobalInferenceGatewayRoutingWeights < Struct.new( :kv_headroom, :queue_depth, :region_proximity, :error_rate) SENSITIVE = [] include Aws::Structure end |
#queue_depth ⇒ Float
The weight of the number of requests that are waiting on the cluster.
30835 30836 30837 30838 30839 30840 30841 30842 |
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 30835 class GlobalInferenceGatewayRoutingWeights < Struct.new( :kv_headroom, :queue_depth, :region_proximity, :error_rate) SENSITIVE = [] include Aws::Structure end |
#region_proximity ⇒ Float
The weight of how close the cluster is to the caller.
30835 30836 30837 30838 30839 30840 30841 30842 |
# File 'gems/aws-sdk-sagemaker/lib/aws-sdk-sagemaker/types.rb', line 30835 class GlobalInferenceGatewayRoutingWeights < Struct.new( :kv_headroom, :queue_depth, :region_proximity, :error_rate) SENSITIVE = [] include Aws::Structure end |