software.amazon.awscdk.services.sagemaker

Interface CfnModel.MultiModelConfigProperty

All Known Implementing Classes:

CfnModel.MultiModelConfigProperty.Jsii$Proxy

Enclosing class:

CfnModel

public static interface CfnModel.MultiModelConfigProperty

Specifies additional configuration for hosting multi-model endpoints.

Example:

 // The code below shows an example of how to instantiate this type.
 // The values are placeholders you should change.
 import software.amazon.awscdk.services.sagemaker.*;
 MultiModelConfigProperty multiModelConfigProperty = MultiModelConfigProperty.builder()
         .modelCacheSetting("modelCacheSetting")
         .build();
 

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	CfnModel.MultiModelConfigProperty.Builder A builder for CfnModel.MultiModelConfigProperty
static class	CfnModel.MultiModelConfigProperty.Jsii$Proxy An implementation for CfnModel.MultiModelConfigProperty

Method Summary

Modifier and Type	Method and Description
static CfnModel.MultiModelConfigProperty.Builder	builder()
default java.lang.String	getModelCacheSetting() Whether to cache models for a multi-model endpoint.

Method Detail

getModelCacheSetting

default java.lang.String getModelCacheSetting()

Whether to cache models for a multi-model endpoint.

By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.

builder

static CfnModel.MultiModelConfigProperty.Builder builder()

Returns:

a CfnModel.MultiModelConfigProperty.Builder of CfnModel.MultiModelConfigProperty