/AWS1/CL_SGMASYNCINFERENCECL00¶
Configures the behavior of the client used by SageMaker to interact with the model container during asynchronous inference.
CONSTRUCTOR
¶
IMPORTING¶
Optional arguments:¶
iv_maxconcurrentinvcsperinst
TYPE /AWS1/SGMMAXCONCURRENTINVSPE00
/AWS1/SGMMAXCONCURRENTINVSPE00
¶
The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, SageMaker chooses an optimal value.
Queryable Attributes¶
MaxConcurrentInvocationsPerInstance¶
The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, SageMaker chooses an optimal value.
Accessible with the following methods¶
Method | Description |
---|---|
GET_MAXCONCURRENTINVCSPERI00() |
Getter for MAXCONCURRENTINVCSPERINST, with configurable defa |
ASK_MAXCONCURRENTINVCSPERI00() |
Getter for MAXCONCURRENTINVCSPERINST w/ exceptions if field |
HAS_MAXCONCURRENTINVCSPERI00() |
Determine if MAXCONCURRENTINVCSPERINST has a value |