SageMakerGatewayRuntime / Client / exceptions / ThrottlingException

ThrottlingException

class SageMakerGatewayRuntime.Client.exceptions.ThrottlingException

The request was throttled before it was dispatched for inference. Retry the request with backoff, after the Retry-After seconds when the response carries one. A message starting inference gateway means the last inference gateway tried for the model returned a 429. The gateway may have tried others first, and they may have failed for other reasons. Up to 256 bytes of its error message are quoted.

Example

try:
  ...
except client.exceptions.ThrottlingException as e:
  print(e.response)
response

The parsed error response. All exceptions have a top level Error key that provides normalized access to common exception atrributes. All other keys are specific to this service or exception class.

Syntax

{
    'Message': 'string',
    'Error': {
        'Code': 'string',
        'Message': 'string'
    }
}

Structure

  • (dict) –

    The request was throttled before it was dispatched for inference. Retry the request with backoff, after the Retry-After seconds when the response carries one. A message starting inference gateway means the last inference gateway tried for the model returned a 429. The gateway may have tried others first, and they may have failed for other reasons. Up to 256 bytes of its error message are quoted.

    • Message (string) –

      A description of the error. It starts with a prefix such as Global Inference Gateway: or inference gateway: that says where the error came from.

    • Error (dict) – Normalized access to common exception attributes.

      • Code (string) – An identifier specifying the exception type.

      • Message (string) – A descriptive message explaining why the exception occured.