aws-cdk-lib.aws_sagemaker.CfnEndpointConfig.AsyncInferenceClientConfigProperty

AsyncInferenceClientConfigProperty Struct

Configures the behavior of the client used by SageMaker to interact with the model container during asynchronous inference.

Source

Generated code

Type last changed

v2.93.0 · 23 Aug 2023

Example

// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_sagemaker as sagemaker } from 'aws-cdk-lib';
const asyncInferenceClientConfigProperty: sagemaker.CfnEndpointConfig.AsyncInferenceClientConfigProperty = {
  maxConcurrentInvocationsPerInstance: 123,
};

Properties

maxConcurrentInvocationsPerInstance?optionalnumbermax_concurrent_invocations_per_instance?optionalint | floatmaxConcurrentInvocationsPerInstance?optionalNumberMaxConcurrentInvocationsPerInstance?optionaldoubleMaxConcurrentInvocationsPerInstance?optional*float64#

The maximum number of concurrent requests sent by the SageMaker client to the model container.

If no value is provided, SageMaker will choose an optimal value for you.