Interface CfnEndpointConfig.IAsyncInferenceClientConfigProperty
Configures the behavior of the client used by SageMaker to interact with the model container during asynchronous inference.
Namespace: Amazon.CDK.AWS.Sagemaker
Assembly: Amazon.CDK.AWS.Sagemaker.dll
Syntax (csharp)
public interface IAsyncInferenceClientConfigProperty
Syntax (vb)
Public Interface IAsyncInferenceClientConfigProperty
Remarks
ExampleMetadata: fixture=_generated
Examples
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
using Amazon.CDK.AWS.Sagemaker;
var asyncInferenceClientConfigProperty = new AsyncInferenceClientConfigProperty {
MaxConcurrentInvocationsPerInstance = 123
};
Synopsis
Properties
MaxConcurrentInvocationsPerInstance | The maximum number of concurrent requests sent by the SageMaker client to the model container. |
Properties
MaxConcurrentInvocationsPerInstance
The maximum number of concurrent requests sent by the SageMaker client to the model container.
virtual Nullable<double> MaxConcurrentInvocationsPerInstance { get; }
Property Value
System.Nullable<System.Double>
Remarks
If no value is provided, SageMaker will choose an optimal value for you.