Interface InvokeInferenceRouterAsyncRequest.Builder

  • Method Details

    • inferenceRouterName

      InvokeInferenceRouterAsyncRequest.Builder inferenceRouterName(String inferenceRouterName)

      The name of the inference router to invoke.

      Parameters:
      inferenceRouterName - The name of the inference router to invoke.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • routingTargetName

      InvokeInferenceRouterAsyncRequest.Builder routingTargetName(String routingTargetName)

      The name of the routing target in the inference router. The routing target must be configured for asynchronous inference.

      Parameters:
      routingTargetName - The name of the routing target in the inference router. The routing target must be configured for asynchronous inference.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • contentType

      The MIME type of the input data in Amazon S3. The router passes it to the destination.

      Parameters:
      contentType - The MIME type of the input data in Amazon S3. The router passes it to the destination.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • accept

      The MIME type that you want for the inference response. The router passes it to the destination.

      Parameters:
      accept - The MIME type that you want for the inference response. The router passes it to the destination.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • customAttributes

      InvokeInferenceRouterAsyncRequest.Builder customAttributes(String customAttributes)

      Provides additional information about the inference request. The value is an opaque string that the router passes, unchanged, to the model container of the destination that serves the request. The value can contain up to 1,024 visible US-ASCII characters.

      Parameters:
      customAttributes - Provides additional information about the inference request. The value is an opaque string that the router passes, unchanged, to the model container of the destination that serves the request. The value can contain up to 1,024 visible US-ASCII characters.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • inferenceId

      An identifier for the inference request. If you don't provide one, SageMaker AI generates one and returns it in the response.

      Parameters:
      inferenceId - An identifier for the inference request. If you don't provide one, SageMaker AI generates one and returns it in the response.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • inputLocation

      InvokeInferenceRouterAsyncRequest.Builder inputLocation(String inputLocation)

      The Amazon S3 URI of the object that contains the input data for the inference. The bucket must be in the inference router's Amazon Web Services Region and owned by the router's account. The destination endpoint's execution role reads the object, and the destination's asynchronous inference limits apply to it.

      Parameters:
      inputLocation - The Amazon S3 URI of the object that contains the input data for the inference. The bucket must be in the inference router's Amazon Web Services Region and owned by the router's account. The destination endpoint's execution role reads the object, and the destination's asynchronous inference limits apply to it.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • s3OutputPathExtension

      InvokeInferenceRouterAsyncRequest.Builder s3OutputPathExtension(String s3OutputPathExtension)

      The path extension that is appended to the routing target's Amazon S3 output path where the inference response is stored.

      Parameters:
      s3OutputPathExtension - The path extension that is appended to the routing target's Amazon S3 output path where the inference response is stored.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • filename

      The file name of the inference response stored in Amazon S3. If you don't provide one, SageMaker AI generates one.

      Parameters:
      filename - The file name of the inference response stored in Amazon S3. If you don't provide one, SageMaker AI generates one.
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • requestTTLSeconds

      InvokeInferenceRouterAsyncRequest.Builder requestTTLSeconds(Integer requestTTLSeconds)

      The time to live of the request, in seconds, measured from when the router accepts it. If no destination starts the request in this time, the request fails. The default is 21,600 seconds (6 hours).

      Parameters:
      requestTTLSeconds - The time to live of the request, in seconds, measured from when the router accepts it. If no destination starts the request in this time, the request fails. The default is 21,600 seconds (6 hours).
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • invocationTimeoutSeconds

      InvokeInferenceRouterAsyncRequest.Builder invocationTimeoutSeconds(Integer invocationTimeoutSeconds)

      The maximum time, in seconds, that a destination can spend processing the request before the request is marked as expired. The default is 900 seconds (15 minutes).

      Parameters:
      invocationTimeoutSeconds - The maximum time, in seconds, that a destination can spend processing the request before the request is marked as expired. The default is 900 seconds (15 minutes).
      Returns:
      Returns a reference to this object so that method calls can be chained together.
    • overrideConfiguration

      InvokeInferenceRouterAsyncRequest.Builder overrideConfiguration(AwsRequestOverrideConfiguration overrideConfiguration)
      Description copied from interface: AwsRequest.Builder
      Add an optional request override configuration.
      Specified by:
      overrideConfiguration in interface AwsRequest.Builder
      Parameters:
      overrideConfiguration - The override configuration.
      Returns:
      This object for method chaining.
    • overrideConfiguration

      Description copied from interface: AwsRequest.Builder
      Add an optional request override configuration.
      Specified by:
      overrideConfiguration in interface AwsRequest.Builder
      Parameters:
      builderConsumer - A Consumer to which an empty AwsRequestOverrideConfiguration.Builder will be given.
      Returns:
      This object for method chaining.