Class CfnPromptVersion.PromptModelInferenceConfigurationProperty
Contains inference configurations related to model inference for a prompt.
Inheritance
Namespace: Amazon.CDK.AwsBedrock
Assembly: Amazon.CDK.Lib.dll
Syntax (csharp)
public class PromptModelInferenceConfigurationProperty : Object, CfnPromptVersion.IPromptModelInferenceConfigurationPropertySyntax (vb)
Public Class PromptModelInferenceConfigurationProperty
Inherits Object
Implements CfnPromptVersion.IPromptModelInferenceConfigurationPropertyRemarks
For more information, see Inference parameters .
ExampleMetadata: fixture=_generated
Examples
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
using Amazon.CDK.Aws_bedrock;
var promptModelInferenceConfigurationProperty = new PromptModelInferenceConfigurationProperty {
MaxTokens = 123,
StopSequences = new [] { "stopSequences" },
Temperature = 123,
TopP = 123
};Synopsis
Constructors
| Prompt |
Properties
| Max |
The maximum number of tokens to return in the response. |
| Stop |
A list of strings that define sequences after which the model will stop generating. |
| Temperature | Controls the randomness of the response. |
| Top |
The percentage of most-likely candidates that the model considers for the next token. |
Constructors
PromptModelInferenceConfigurationProperty()
public PromptModelInferenceConfigurationProperty()Properties
MaxTokens
The maximum number of tokens to return in the response.
public Nullable<double> MaxTokens { get; set; }Property Value
System.
Remarks
StopSequences
A list of strings that define sequences after which the model will stop generating.
public string[] StopSequences { get; set; }Property Value
System.
Remarks
Temperature
Controls the randomness of the response.
public Nullable<double> Temperature { get; set; }Property Value
System.
Remarks
Choose a lower value for more predictable outputs and a higher value for more surprising outputs.
TopP
The percentage of most-likely candidates that the model considers for the next token.
public Nullable<double> TopP { get; set; }Property Value
System.