class CfnEndpointConfig (construct)
Language | Type name |
---|---|
.NET | Amazon.CDK.AWS.Sagemaker.CfnEndpointConfig |
Go | github.com/aws/aws-cdk-go/awscdk/v2/awssagemaker#CfnEndpointConfig |
Java | software.amazon.awscdk.services.sagemaker.CfnEndpointConfig |
Python | aws_cdk.aws_sagemaker.CfnEndpointConfig |
TypeScript | aws-cdk-lib » aws_sagemaker » CfnEndpointConfig |
Implements
IConstruct
, IDependable
, IInspectable
, ITaggable
The AWS::SageMaker::EndpointConfig
resource creates a configuration for an Amazon SageMaker endpoint.
For more information, see CreateEndpointConfig in the SageMaker Developer Guide .
Example
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_sagemaker as sagemaker } from 'aws-cdk-lib';
const cfnEndpointConfig = new sagemaker.CfnEndpointConfig(this, 'MyCfnEndpointConfig', {
productionVariants: [{
variantName: 'variantName',
// the properties below are optional
acceleratorType: 'acceleratorType',
containerStartupHealthCheckTimeoutInSeconds: 123,
enableSsmAccess: false,
initialInstanceCount: 123,
initialVariantWeight: 123,
instanceType: 'instanceType',
managedInstanceScaling: {
maxInstanceCount: 123,
minInstanceCount: 123,
status: 'status',
},
modelDataDownloadTimeoutInSeconds: 123,
modelName: 'modelName',
routingConfig: {
routingStrategy: 'routingStrategy',
},
serverlessConfig: {
maxConcurrency: 123,
memorySizeInMb: 123,
// the properties below are optional
provisionedConcurrency: 123,
},
volumeSizeInGb: 123,
}],
// the properties below are optional
asyncInferenceConfig: {
outputConfig: {
kmsKeyId: 'kmsKeyId',
notificationConfig: {
errorTopic: 'errorTopic',
includeInferenceResponseIn: ['includeInferenceResponseIn'],
successTopic: 'successTopic',
},
s3FailurePath: 's3FailurePath',
s3OutputPath: 's3OutputPath',
},
// the properties below are optional
clientConfig: {
maxConcurrentInvocationsPerInstance: 123,
},
},
dataCaptureConfig: {
captureOptions: [{
captureMode: 'captureMode',
}],
destinationS3Uri: 'destinationS3Uri',
initialSamplingPercentage: 123,
// the properties below are optional
captureContentTypeHeader: {
csvContentTypes: ['csvContentTypes'],
jsonContentTypes: ['jsonContentTypes'],
},
enableCapture: false,
kmsKeyId: 'kmsKeyId',
},
enableNetworkIsolation: false,
endpointConfigName: 'endpointConfigName',
executionRoleArn: 'executionRoleArn',
explainerConfig: {
clarifyExplainerConfig: {
shapConfig: {
shapBaselineConfig: {
mimeType: 'mimeType',
shapBaseline: 'shapBaseline',
shapBaselineUri: 'shapBaselineUri',
},
// the properties below are optional
numberOfSamples: 123,
seed: 123,
textConfig: {
granularity: 'granularity',
language: 'language',
},
useLogit: false,
},
// the properties below are optional
enableExplanations: 'enableExplanations',
inferenceConfig: {
contentTemplate: 'contentTemplate',
featureHeaders: ['featureHeaders'],
featuresAttribute: 'featuresAttribute',
featureTypes: ['featureTypes'],
labelAttribute: 'labelAttribute',
labelHeaders: ['labelHeaders'],
labelIndex: 123,
maxPayloadInMb: 123,
maxRecordCount: 123,
probabilityAttribute: 'probabilityAttribute',
probabilityIndex: 123,
},
},
},
kmsKeyId: 'kmsKeyId',
shadowProductionVariants: [{
variantName: 'variantName',
// the properties below are optional
acceleratorType: 'acceleratorType',
containerStartupHealthCheckTimeoutInSeconds: 123,
enableSsmAccess: false,
initialInstanceCount: 123,
initialVariantWeight: 123,
instanceType: 'instanceType',
managedInstanceScaling: {
maxInstanceCount: 123,
minInstanceCount: 123,
status: 'status',
},
modelDataDownloadTimeoutInSeconds: 123,
modelName: 'modelName',
routingConfig: {
routingStrategy: 'routingStrategy',
},
serverlessConfig: {
maxConcurrency: 123,
memorySizeInMb: 123,
// the properties below are optional
provisionedConcurrency: 123,
},
volumeSizeInGb: 123,
}],
tags: [{
key: 'key',
value: 'value',
}],
vpcConfig: {
securityGroupIds: ['securityGroupIds'],
subnets: ['subnets'],
},
});
Initializer
new CfnEndpointConfig(scope: Construct, id: string, props: CfnEndpointConfigProps)
Parameters
- scope
Construct
— Scope in which this resource is defined. - id
string
— Construct identifier for this resource (unique in its scope). - props
Cfn
— Resource properties.Endpoint Config Props
Construct Props
Name | Type | Description |
---|---|---|
production | IResolvable | IResolvable | Production [] | A list of ProductionVariant objects, one for each model that you want to host at this endpoint. |
async | IResolvable | Async | Specifies configuration for how an endpoint performs asynchronous inference. |
data | IResolvable | Data | Specifies how to capture endpoint data for model monitor. |
enable | boolean | IResolvable | |
endpoint | string | The name of the endpoint configuration. |
execution | string | |
explainer | IResolvable | Explainer | A parameter to activate explainers. |
kms | string | The Amazon Resource Name (ARN) of an AWS Key Management Service key that Amazon SageMaker uses to encrypt data on the storage volume attached to the ML compute instance that hosts the endpoint. |
shadow | IResolvable | IResolvable | Production [] | Array of ProductionVariant objects. |
tags? | Cfn [] | A list of key-value pairs to apply to this resource. |
vpc | IResolvable | Vpc |
productionVariants
Type:
IResolvable
|
IResolvable
|
Production
[]
A list of ProductionVariant
objects, one for each model that you want to host at this endpoint.
asyncInferenceConfig?
Type:
IResolvable
|
Async
(optional)
Specifies configuration for how an endpoint performs asynchronous inference.
dataCaptureConfig?
Type:
IResolvable
|
Data
(optional)
Specifies how to capture endpoint data for model monitor.
The data capture configuration applies to all production variants hosted at the endpoint.
enableNetworkIsolation?
Type:
boolean |
IResolvable
(optional)
endpointConfigName?
Type:
string
(optional)
The name of the endpoint configuration.
executionRoleArn?
Type:
string
(optional)
explainerConfig?
Type:
IResolvable
|
Explainer
(optional)
A parameter to activate explainers.
kmsKeyId?
Type:
string
(optional)
The Amazon Resource Name (ARN) of an AWS Key Management Service key that Amazon SageMaker uses to encrypt data on the storage volume attached to the ML compute instance that hosts the endpoint.
- Key ID:
1234abcd-12ab-34cd-56ef-1234567890ab
- Key ARN:
arn:aws:kms:us-west-2:111122223333:key/1234abcd-12ab-34cd-56ef-1234567890ab
- Alias name:
alias/ExampleAlias
- Alias name ARN:
arn:aws:kms:us-west-2:111122223333:alias/ExampleAlias
The KMS key policy must grant permission to the IAM role that you specify in your CreateEndpoint
, UpdateEndpoint
requests. For more information, refer to the AWS Key Management Service section Using Key Policies in AWS KMS
Certain Nitro-based instances include local storage, dependent on the instance type. Local storage volumes are encrypted using a hardware module on the instance. You can't request a
KmsKeyId
when using an instance type with local storage. If any of the models that you specify in theProductionVariants
parameter use nitro-based instances with local storage, do not specify a value for theKmsKeyId
parameter. If you specify a value forKmsKeyId
when using any nitro-based instances with local storage, the call toCreateEndpointConfig
fails.For a list of instance types that support local instance storage, see Instance Store Volumes .
For more information about local instance storage encryption, see SSD Instance Store Volumes .
shadowProductionVariants?
Type:
IResolvable
|
IResolvable
|
Production
[]
(optional)
Array of ProductionVariant
objects.
There is one for each model that you want to host at this endpoint in shadow mode with production traffic replicated from the model specified on ProductionVariants
. If you use this field, you can only specify one variant for ProductionVariants
and one variant for ShadowProductionVariants
.
tags?
Type:
Cfn
[]
(optional)
A list of key-value pairs to apply to this resource.
For more information, see Resource Tag and Using Cost Allocation Tags .
vpcConfig?
Type:
IResolvable
|
Vpc
(optional)
Properties
Name | Type | Description |
---|---|---|
attr | string | The name of the endpoint configuration, such as MyEndpointConfiguration . |
attr | string | |
cfn | ICfn | Options for this resource, such as condition, update policy etc. |
cfn | { [string]: any } | |
cfn | string | AWS resource type. |
creation | string[] | |
logical | string | The logical ID for this CloudFormation stack element. |
node | Node | The tree node. |
production | IResolvable | IResolvable | Production [] | A list of ProductionVariant objects, one for each model that you want to host at this endpoint. |
ref | string | Return a string that will be resolved to a CloudFormation { Ref } for this element. |
stack | Stack | The stack in which this element is defined. |
tags | Tag | Tag Manager which manages the tags for this resource. |
async | IResolvable | Async | Specifies configuration for how an endpoint performs asynchronous inference. |
data | IResolvable | Data | Specifies how to capture endpoint data for model monitor. |
enable | boolean | IResolvable | |
endpoint | string | The name of the endpoint configuration. |
execution | string | |
explainer | IResolvable | Explainer | A parameter to activate explainers. |
kms | string | The Amazon Resource Name (ARN) of an AWS Key Management Service key that Amazon SageMaker uses to encrypt data on the storage volume attached to the ML compute instance that hosts the endpoint. |
shadow | IResolvable | IResolvable | Production [] | Array of ProductionVariant objects. |
tags | Cfn [] | A list of key-value pairs to apply to this resource. |
vpc | IResolvable | Vpc | |
static CFN_RESOURCE_TYPE_NAME | string | The CloudFormation resource type name for this resource class. |
attrEndpointConfigName
Type:
string
The name of the endpoint configuration, such as MyEndpointConfiguration
.
attrId
Type:
string
cfnOptions
Type:
ICfn
Options for this resource, such as condition, update policy etc.
cfnProperties
Type:
{ [string]: any }
cfnResourceType
Type:
string
AWS resource type.
creationStack
Type:
string[]
logicalId
Type:
string
The logical ID for this CloudFormation stack element.
The logical ID of the element is calculated from the path of the resource node in the construct tree.
To override this value, use overrideLogicalId(newLogicalId)
.
node
Type:
Node
The tree node.
productionVariants
Type:
IResolvable
|
IResolvable
|
Production
[]
A list of ProductionVariant
objects, one for each model that you want to host at this endpoint.
ref
Type:
string
Return a string that will be resolved to a CloudFormation { Ref }
for this element.
If, by any chance, the intrinsic reference of a resource is not a string, you could
coerce it to an IResolvable through Lazy.any({ produce: resource.ref })
.
stack
Type:
Stack
The stack in which this element is defined.
CfnElements must be defined within a stack scope (directly or indirectly).
tags
Type:
Tag
Tag Manager which manages the tags for this resource.
asyncInferenceConfig?
Type:
IResolvable
|
Async
(optional)
Specifies configuration for how an endpoint performs asynchronous inference.
dataCaptureConfig?
Type:
IResolvable
|
Data
(optional)
Specifies how to capture endpoint data for model monitor.
enableNetworkIsolation?
Type:
boolean |
IResolvable
(optional)
endpointConfigName?
Type:
string
(optional)
The name of the endpoint configuration.
executionRoleArn?
Type:
string
(optional)
explainerConfig?
Type:
IResolvable
|
Explainer
(optional)
A parameter to activate explainers.
kmsKeyId?
Type:
string
(optional)
The Amazon Resource Name (ARN) of an AWS Key Management Service key that Amazon SageMaker uses to encrypt data on the storage volume attached to the ML compute instance that hosts the endpoint.
shadowProductionVariants?
Type:
IResolvable
|
IResolvable
|
Production
[]
(optional)
Array of ProductionVariant
objects.
tagsRaw?
Type:
Cfn
[]
(optional)
A list of key-value pairs to apply to this resource.
vpcConfig?
Type:
IResolvable
|
Vpc
(optional)
static CFN_RESOURCE_TYPE_NAME
Type:
string
The CloudFormation resource type name for this resource class.
Methods
Name | Description |
---|---|
add | Syntactic sugar for addOverride(path, undefined) . |
add | Indicates that this resource depends on another resource and cannot be provisioned unless the other resource has been successfully provisioned. |
add | Indicates that this resource depends on another resource and cannot be provisioned unless the other resource has been successfully provisioned. |
add | Add a value to the CloudFormation Resource Metadata. |
add | Adds an override to the synthesized CloudFormation resource. |
add | Adds an override that deletes the value of a property from the resource definition. |
add | Adds an override to a resource property. |
apply | Sets the deletion policy of the resource based on the removal policy specified. |
get | Returns a token for an runtime attribute of this resource. |
get | Retrieve a value value from the CloudFormation Resource Metadata. |
inspect(inspector) | Examines the CloudFormation resource and discloses attributes. |
obtain | Retrieves an array of resources this resource depends on. |
obtain | Get a shallow copy of dependencies between this resource and other resources in the same stack. |
override | Overrides the auto-generated logical ID with a specific ID. |
remove | Indicates that this resource no longer depends on another resource. |
replace | Replaces one dependency with another. |
to | Returns a string representation of this construct. |
protected render |
DeletionOverride(path)
addpublic addDeletionOverride(path: string): void
Parameters
- path
string
— The path of the value to delete.
Syntactic sugar for addOverride(path, undefined)
.
Dependency(target)
addpublic addDependency(target: CfnResource): void
Parameters
- target
Cfn
Resource
Indicates that this resource depends on another resource and cannot be provisioned unless the other resource has been successfully provisioned.
This can be used for resources across stacks (or nested stack) boundaries and the dependency will automatically be transferred to the relevant scope.
DependsOn(target)
addpublic addDependsOn(target: CfnResource): void
⚠️ Deprecated: use addDependency
Parameters
- target
Cfn
Resource
Indicates that this resource depends on another resource and cannot be provisioned unless the other resource has been successfully provisioned.
Metadata(key, value)
addpublic addMetadata(key: string, value: any): void
Parameters
- key
string
- value
any
Add a value to the CloudFormation Resource Metadata.
See also: [https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/metadata-section-structure.html
Note that this is a different set of metadata from CDK node metadata; this metadata ends up in the stack template under the resource, whereas CDK node metadata ends up in the Cloud Assembly.](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/metadata-section-structure.html
Note that this is a different set of metadata from CDK node metadata; this metadata ends up in the stack template under the resource, whereas CDK node metadata ends up in the Cloud Assembly.)
Override(path, value)
addpublic addOverride(path: string, value: any): void
Parameters
- path
string
— - The path of the property, you can use dot notation to override values in complex types. - value
any
— - The value.
Adds an override to the synthesized CloudFormation resource.
To add a
property override, either use addPropertyOverride
or prefix path
with
"Properties." (i.e. Properties.TopicName
).
If the override is nested, separate each nested level using a dot (.) in the path parameter. If there is an array as part of the nesting, specify the index in the path.
To include a literal .
in the property name, prefix with a \
. In most
programming languages you will need to write this as "\\."
because the
\
itself will need to be escaped.
For example,
cfnResource.addOverride('Properties.GlobalSecondaryIndexes.0.Projection.NonKeyAttributes', ['myattribute']);
cfnResource.addOverride('Properties.GlobalSecondaryIndexes.1.ProjectionType', 'INCLUDE');
would add the overrides
"Properties": {
"GlobalSecondaryIndexes": [
{
"Projection": {
"NonKeyAttributes": [ "myattribute" ]
...
}
...
},
{
"ProjectionType": "INCLUDE"
...
},
]
...
}
The value
argument to addOverride
will not be processed or translated
in any way. Pass raw JSON values in here with the correct capitalization
for CloudFormation. If you pass CDK classes or structs, they will be
rendered with lowercased key names, and CloudFormation will reject the
template.
PropertyDeletionOverride(propertyPath)
addpublic addPropertyDeletionOverride(propertyPath: string): void
Parameters
- propertyPath
string
— The path to the property.
Adds an override that deletes the value of a property from the resource definition.
PropertyOverride(propertyPath, value)
addpublic addPropertyOverride(propertyPath: string, value: any): void
Parameters
- propertyPath
string
— The path of the property. - value
any
— The value.
Adds an override to a resource property.
Syntactic sugar for addOverride("Properties.<...>", value)
.
RemovalPolicy(policy?, options?)
applypublic applyRemovalPolicy(policy?: RemovalPolicy, options?: RemovalPolicyOptions): void
Parameters
- policy
Removal
Policy - options
Removal
Policy Options
Sets the deletion policy of the resource based on the removal policy specified.
The Removal Policy controls what happens to this resource when it stops being managed by CloudFormation, either because you've removed it from the CDK application or because you've made a change that requires the resource to be replaced.
The resource can be deleted (RemovalPolicy.DESTROY
), or left in your AWS
account for data recovery and cleanup later (RemovalPolicy.RETAIN
). In some
cases, a snapshot can be taken of the resource prior to deletion
(RemovalPolicy.SNAPSHOT
). A list of resources that support this policy
can be found in the following link:
Att(attributeName, typeHint?)
getpublic getAtt(attributeName: string, typeHint?: ResolutionTypeHint): Reference
Parameters
- attributeName
string
— The name of the attribute. - typeHint
Resolution
Type Hint
Returns
Returns a token for an runtime attribute of this resource.
Ideally, use generated attribute accessors (e.g. resource.arn
), but this can be used for future compatibility
in case there is no generated attribute.
Metadata(key)
getpublic getMetadata(key: string): any
Parameters
- key
string
Returns
any
Retrieve a value value from the CloudFormation Resource Metadata.
See also: [https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/metadata-section-structure.html
Note that this is a different set of metadata from CDK node metadata; this metadata ends up in the stack template under the resource, whereas CDK node metadata ends up in the Cloud Assembly.](https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/metadata-section-structure.html
Note that this is a different set of metadata from CDK node metadata; this metadata ends up in the stack template under the resource, whereas CDK node metadata ends up in the Cloud Assembly.)
inspect(inspector)
public inspect(inspector: TreeInspector): void
Parameters
- inspector
Tree
— tree inspector to collect and process attributes.Inspector
Examines the CloudFormation resource and discloses attributes.
Dependencies()
obtainpublic obtainDependencies(): Stack | CfnResource[]
Returns
Stack
|
Cfn
Resource []
Retrieves an array of resources this resource depends on.
This assembles dependencies on resources across stacks (including nested stacks) automatically.
ResourceDependencies()
obtainpublic obtainResourceDependencies(): CfnResource[]
Returns
Get a shallow copy of dependencies between this resource and other resources in the same stack.
LogicalId(newLogicalId)
overridepublic overrideLogicalId(newLogicalId: string): void
Parameters
- newLogicalId
string
— The new logical ID to use for this stack element.
Overrides the auto-generated logical ID with a specific ID.
Dependency(target)
removepublic removeDependency(target: CfnResource): void
Parameters
- target
Cfn
Resource
Indicates that this resource no longer depends on another resource.
This can be used for resources across stacks (including nested stacks) and the dependency will automatically be removed from the relevant scope.
Dependency(target, newTarget)
replacepublic replaceDependency(target: CfnResource, newTarget: CfnResource): void
Parameters
- target
Cfn
— The dependency to replace.Resource - newTarget
Cfn
— The new dependency to add.Resource
Replaces one dependency with another.
String()
topublic toString(): string
Returns
string
Returns a string representation of this construct.
Properties(props)
protected renderprotected renderProperties(props: { [string]: any }): { [string]: any }
Parameters
- props
{ [string]: any }
Returns
{ [string]: any }