Skip to content
v2.274.0

InferenceComponentCapacitySizeProperty Struct ​

Specifies the type and size of the endpoint capacity to activate for a rolling deployment or a rollback strategy.

You can specify your batches as either of the following:

  • A count of inference component copies
  • The overall percentage or your fleet

For a rollback strategy, if you don't specify the fields in this object, or if you set the Value parameter to 100%, then SageMaker AI uses a blue/green rollback strategy and rolls all traffic back to the blue fleet.

Example ​

ts
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_sagemaker as sagemaker } from 'aws-cdk-lib';
const inferenceComponentCapacitySizeProperty: sagemaker.CfnInferenceComponent.InferenceComponentCapacitySizeProperty = {
  type: 'type',
  value: 123,
};

Properties ​

typestringtypestrtypeStringTypestringType*stringrequired#
Specifies the endpoint capacity type.
  • COPY_COUNT - The endpoint activates based on the number of inference component copies.
  • CAPACITY_PERCENT - The endpoint activates based on the specified percentage of capacity.
valuenumbervalueint | floatvalueNumberValuedoubleValue*float64required#
Defines the capacity size, either as a number of inference component copies or a capacity percentage.