@Generated(value="com.amazonaws:aws-java-sdk-code-generator") public class MultiModelConfig extends Object implements Serializable, Cloneable, StructuredPojo
Specifies additional configuration for hosting multi-model endpoints.
Constructor and Description |
---|
MultiModelConfig() |
Modifier and Type | Method and Description |
---|---|
MultiModelConfig |
clone() |
boolean |
equals(Object obj) |
String |
getModelCacheSetting()
Whether to cache models for a multi-model endpoint.
|
int |
hashCode() |
void |
marshall(ProtocolMarshaller protocolMarshaller)
Marshalls this structured data using the given
ProtocolMarshaller . |
void |
setModelCacheSetting(String modelCacheSetting)
Whether to cache models for a multi-model endpoint.
|
String |
toString()
Returns a string representation of this object.
|
MultiModelConfig |
withModelCacheSetting(ModelCacheSetting modelCacheSetting)
Whether to cache models for a multi-model endpoint.
|
MultiModelConfig |
withModelCacheSetting(String modelCacheSetting)
Whether to cache models for a multi-model endpoint.
|
public void setModelCacheSetting(String modelCacheSetting)
Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a
model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model
caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the
endpoint might perform better if you disable model caching. To disable model caching, set the value of this
parameter to Disabled
.
modelCacheSetting
- Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that
a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from
model caching. For example, if an endpoint hosts a large number of models that are each invoked
infrequently, the endpoint might perform better if you disable model caching. To disable model caching,
set the value of this parameter to Disabled
.ModelCacheSetting
public String getModelCacheSetting()
Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a
model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model
caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the
endpoint might perform better if you disable model caching. To disable model caching, set the value of this
parameter to Disabled
.
Disabled
.ModelCacheSetting
public MultiModelConfig withModelCacheSetting(String modelCacheSetting)
Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a
model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model
caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the
endpoint might perform better if you disable model caching. To disable model caching, set the value of this
parameter to Disabled
.
modelCacheSetting
- Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that
a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from
model caching. For example, if an endpoint hosts a large number of models that are each invoked
infrequently, the endpoint might perform better if you disable model caching. To disable model caching,
set the value of this parameter to Disabled
.ModelCacheSetting
public MultiModelConfig withModelCacheSetting(ModelCacheSetting modelCacheSetting)
Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a
model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model
caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the
endpoint might perform better if you disable model caching. To disable model caching, set the value of this
parameter to Disabled
.
modelCacheSetting
- Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that
a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from
model caching. For example, if an endpoint hosts a large number of models that are each invoked
infrequently, the endpoint might perform better if you disable model caching. To disable model caching,
set the value of this parameter to Disabled
.ModelCacheSetting
public String toString()
toString
in class Object
Object.toString()
public MultiModelConfig clone()
public void marshall(ProtocolMarshaller protocolMarshaller)
StructuredPojo
ProtocolMarshaller
.marshall
in interface StructuredPojo
protocolMarshaller
- Implementation of ProtocolMarshaller
used to marshall this object's data.