InferenceComponentCapacitySizeProperty Struct
Specifies the type and size of the endpoint capacity to activate for a rolling deployment or a rollback strategy.
You can specify your batches as either of the following:
- A count of inference component copies
- The overall percentage or your fleet
For a rollback strategy, if you don't specify the fields in this object, or if you set the Value parameter to 100%, then SageMaker AI uses a blue/green rollback strategy and rolls all traffic back to the blue fleet.
Example
ts
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_sagemaker as sagemaker } from 'aws-cdk-lib';
const inferenceComponentCapacitySizeProperty: sagemaker.CfnInferenceComponent.InferenceComponentCapacitySizeProperty = {
type: 'type',
value: 123,
};
Properties
Specifies the endpoint capacity type.
- COPY_COUNT - The endpoint activates based on the number of inference component copies.
- CAPACITY_PERCENT - The endpoint activates based on the specified percentage of capacity.
Defines the capacity size, either as a number of inference component copies or a capacity percentage.