InferenceComponentRuntimeConfigProperty Struct
Runtime settings for a model that is deployed with an inference component.
Example
ts
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_sagemaker as sagemaker } from 'aws-cdk-lib';
const inferenceComponentRuntimeConfigProperty: sagemaker.CfnInferenceComponent.InferenceComponentRuntimeConfigProperty = {
copyCount: 123,
currentCopyCount: 123,
desiredCopyCount: 123,
placementStatus: [{
currentCopyCount: 123,
instanceType: 'instanceType',
}],
};
Properties
copyCountoptionalnumbercopy_countoptionalint | floatcopyCountoptionalNumberCopyCountoptionaldoubleCopyCountoptional*float64#The number of runtime copies of the model container to deploy with the inference component.
Each copy can serve inference requests.
currentCopyCountoptionalnumbercurrent_copy_countoptionalint | floatcurrentCopyCountoptionalNumberCurrentCopyCountoptionaldoubleCurrentCopyCountoptional*float64#The number of runtime copies of the model container that are currently deployed.
desiredCopyCountoptionalnumberdesired_copy_countoptionalint | floatdesiredCopyCountoptionalNumberDesiredCopyCountoptionaldoubleDesiredCopyCountoptional*float64#The number of runtime copies of the model container that you requested to deploy with the inference component.
placementStatusoptionalIResolvable | IResolvable | CfnInferenceComponent.InferenceComponentPlacementStatusProperty[]placement_statusoptionaltyping.Union[IResolvable, typing.List[typing.Union[IResolvable, InferenceComponentPlacementStatusProperty]]]placementStatusoptionalIResolvablePlacementStatusoptionalIResolvablePlacementStatusoptionalinterface{}#The placement status of the inference component across instance types.