public static interface CfnModel.MultiModelConfigProperty
Example:
// The code below shows an example of how to instantiate this type. // The values are placeholders you should change. import software.amazon.awscdk.services.sagemaker.*; MultiModelConfigProperty multiModelConfigProperty = MultiModelConfigProperty.builder() .modelCacheSetting("modelCacheSetting") .build();
Modifier and Type | Interface and Description |
---|---|
static class |
CfnModel.MultiModelConfigProperty.Builder
A builder for
CfnModel.MultiModelConfigProperty |
static class |
CfnModel.MultiModelConfigProperty.Jsii$Proxy
An implementation for
CfnModel.MultiModelConfigProperty |
Modifier and Type | Method and Description |
---|---|
static CfnModel.MultiModelConfigProperty.Builder |
builder() |
default java.lang.String |
getModelCacheSetting()
Whether to cache models for a multi-model endpoint.
|
default java.lang.String getModelCacheSetting()
By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.
static CfnModel.MultiModelConfigProperty.Builder builder()