Skip to content

/AWS1/CL_SGMASYNCINFERENCECL00

Configures the behavior of the client used by SageMaker to interact with the model container during asynchronous inference.

CONSTRUCTOR

IMPORTING

Optional arguments:

iv_maxconcurrentinvcsperinst TYPE /AWS1/SGMMAXCONCURRENTINVSPE00 /AWS1/SGMMAXCONCURRENTINVSPE00

The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, SageMaker chooses an optimal value.


Queryable Attributes

MaxConcurrentInvocationsPerInstance

The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, SageMaker chooses an optimal value.

Accessible with the following methods

Method Description
GET_MAXCONCURRENTINVCSPERI00() Getter for MAXCONCURRENTINVCSPERINST, with configurable defa
ASK_MAXCONCURRENTINVCSPERI00() Getter for MAXCONCURRENTINVCSPERINST w/ exceptions if field
HAS_MAXCONCURRENTINVCSPERI00() Determine if MAXCONCURRENTINVCSPERINST has a value