ScaleInPolicyProperty Struct
Specifies how the endpoint releases instances when managed instance scaling scales in.
Example
ts
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_sagemaker as sagemaker } from 'aws-cdk-lib';
const scaleInPolicyProperty: sagemaker.CfnEndpointConfig.ScaleInPolicyProperty = {
strategy: 'strategy',
// the properties below are optional
cooldownInMinutes: 123,
maximumStepSize: 123,
};
Properties
cooldownInMinutesoptionalnumbercooldown_in_minutesoptionalint | floatcooldownInMinutesoptionalNumberCooldownInMinutesoptionaldoubleCooldownInMinutesoptional*float64#The cooldown period, in minutes, after the last endpoint operation before the endpoint evaluates consolidation scale-in opportunities.
Valid values are 5 to 1440. The default is 20.
maximumStepSizeoptionalnumbermaximum_step_sizeoptionalint | floatmaximumStepSizeoptionalNumberMaximumStepSizeoptionaldoubleMaximumStepSizeoptional*float64#The maximum number of instances that the endpoint can terminate at a time during a consolidation scale-in operation.
Valid values are 1 to 100. The default is 1.
The strategy for scaling in instances.
IDLE_RELEASE releases instances that have no hosted inference component copies. CONSOLIDATION consolidates inference component copies onto fewer instances to release more instances.