InferenceConfigurationProperty Struct
The inference configuration parameters that control model behavior during evaluation.
Example
ts
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_bedrockagentcore as bedrockagentcore } from 'aws-cdk-lib';
const inferenceConfigurationProperty: bedrockagentcore.CfnEvaluator.InferenceConfigurationProperty = {
maxTokens: 123,
stopSequences: ['stopSequences'],
temperature: 123,
topP: 123,
};
Properties
maxTokensoptionalnumbermax_tokensoptionalint | floatmaxTokensoptionalNumberMaxTokensoptionaldoubleMaxTokensoptional*float64#The maximum number of tokens to generate in the model response.
stopSequencesoptionalstring[]stop_sequencesoptionaltyping.List[str]stopSequencesoptionalList<String>StopSequencesoptionalstring[]StopSequencesoptional*[]*string#The sequences that make the model stop generating further tokens.
temperatureoptionalnumbertemperatureoptionalint | floattemperatureoptionalNumberTemperatureoptionaldoubleTemperatureoptional*float64#The temperature value that controls randomness in the model's responses.
The top-p sampling parameter that controls the diversity of the model's responses.