Container for the parameters to the CreateInferenceComponent operation. Creates an inference component, which is a SageMaker AI hosting object that you can use to deploy a model to an endpoint. In the inference component settings, you specify the model, the endpoint, and how the model utilizes the resources that the endpoint hosts. You can optimize resource utilization by tailoring how the required CPU cores, accelerators, and memory are allocated. You can deploy multiple inference components to an endpoint, where each inference component contains one model and the resource utilization needs for that individual model. After you deploy an inference component, you can directly invoke the associated model when you use the InvokeEndpoint API action.
Inheritance Hierarchy
Amazon.Runtime.AmazonWebServiceRequest
Amazon.SageMaker.AmazonSageMakerRequest
Amazon.SageMaker.Model.CreateInferenceComponentRequest
Namespace: Amazon.SageMaker.Model
Assembly: AWSSDK.SageMaker.dll
Version: 3.x.y.z
Syntax
public class CreateInferenceComponentRequest : AmazonSageMakerRequest IAmazonWebServiceRequest
The CreateInferenceComponentRequest type exposes the following members
Constructors
| Name | Description | |
|---|---|---|
|
CreateInferenceComponentRequest() |
Properties
| Name | Type | Description | |
|---|---|---|---|
|
|
EndpointName | System.String |
Gets and sets the property EndpointName. The name of an existing endpoint where you host the inference component. |
|
|
InferenceComponentName | System.String |
Gets and sets the property InferenceComponentName. A unique name to assign to the inference component. |
|
|
RuntimeConfig | Amazon.SageMaker.Model.InferenceComponentRuntimeConfig |
Gets and sets the property RuntimeConfig. Runtime settings for a model that is deployed with an inference component. |
|
|
Specification | Amazon.SageMaker.Model.InferenceComponentSpecification |
Gets and sets the property Specification. Details about the resources to deploy with this inference component, including the model, container, and compute resources. |
|
|
Tags | System.Collections.Generic.List<Amazon.SageMaker.Model.Tag> |
Gets and sets the property Tags. A list of key-value pairs associated with the model. For more information, see Tagging Amazon Web Services resources in the Amazon Web Services General Reference. |
|
|
VariantName | System.String |
Gets and sets the property VariantName. The name of an existing production variant where you host the inference component. |
Version Information
.NET:
Supported in: 8.0 and newer, Core 3.1
.NET Standard:
Supported in: 2.0
.NET Framework:
Supported in: 4.5 and newer, 3.5