Class CfnModel.MultiModelConfigProperty
Specifies additional configuration for hosting multi-model endpoints.
Inheritance
System.Object
CfnModel.MultiModelConfigProperty
Implements
Namespace: Amazon.CDK.AWS.Sagemaker
Assembly: Amazon.CDK.Lib.dll
Syntax (csharp)
public class MultiModelConfigProperty : Object, CfnModel.IMultiModelConfigProperty
Syntax (vb)
Public Class MultiModelConfigProperty
Inherits Object
Implements CfnModel.IMultiModelConfigProperty
Remarks
ExampleMetadata: fixture=_generated
Examples
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
using Amazon.CDK.AWS.Sagemaker;
var multiModelConfigProperty = new MultiModelConfigProperty {
ModelCacheSetting = "modelCacheSetting"
};
Synopsis
Constructors
MultiModelConfigProperty() |
Properties
ModelCacheSetting | Whether to cache models for a multi-model endpoint. |
Constructors
MultiModelConfigProperty()
public MultiModelConfigProperty()
Properties
ModelCacheSetting
Whether to cache models for a multi-model endpoint.
public string ModelCacheSetting { get; set; }
Property Value
System.String
Remarks
By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.