PrefixAwareRoutingConfigProperty Struct
The configuration for prefix-aware routing on a SageMaker real-time inference endpoint.
Specify PrefixLength and ConcurrencyThreshold to control routing behavior.
Example
ts
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_sagemaker as sagemaker } from 'aws-cdk-lib';
const prefixAwareRoutingConfigProperty: sagemaker.CfnEndpointConfig.PrefixAwareRoutingConfigProperty = {
concurrencyThreshold: 123,
prefixLength: 123,
};
Properties
concurrencyThresholdnumberconcurrency_thresholdint | floatconcurrencyThresholdNumberConcurrencyThresholddoubleConcurrencyThreshold*float64#The maximum number of in-flight requests on the target instance before the endpoint routes to another instance.
Required when RoutingStrategy is PREFIX_AWARE. Valid values are 1 to 1024.
The maximum length of the prefix used for routing decisions.
Required when RoutingStrategy is PREFIX_AWARE. Valid values are 1024 to 65536.