The configuration details for text generation using a language model via the RetrieveAndGenerate
function.
Inheritance Hierarchy
Namespace: Amazon.Bedrock.Model
Assembly: AWSSDK.Bedrock.dll
Version: 3.x.y.z
Syntax
public class TextInferenceConfig
The TextInferenceConfig type exposes the following members
Constructors
| Name | Description | |
|---|---|---|
|
TextInferenceConfig() |
Properties
| Name | Type | Description | |
|---|---|---|---|
|
|
MaxTokens | System.Int32 |
Gets and sets the property MaxTokens. The maximum number of tokens to generate in the output text. Do not use the minimum of 0 or the maximum of 65536. The limit values described here are arbitrary values, for actual values consult the limits defined by your specific model. |
|
|
StopSequences | System.Collections.Generic.List<System.String> |
Gets and sets the property StopSequences. A list of sequences of characters that, if generated, will cause the model to stop generating further tokens. Do not use a minimum length of 1 or a maximum length of 1000. The limit values described here are arbitrary values, for actual values consult the limits defined by your specific model. |
|
|
Temperature | System.Single |
Gets and sets the property Temperature. Controls the random-ness of text generated by the language model, influencing how much the model sticks to the most predictable next words versus exploring more surprising options. A lower temperature value (e.g. 0.2 or 0.3) makes model outputs more deterministic or predictable, while a higher temperature (e.g. 0.8 or 0.9) makes the outputs more creative or unpredictable. |
|
|
TopP | System.Single |
Gets and sets the property TopP. A probability distribution threshold which controls what the model considers for the set of possible next tokens. The model will only consider the top p% of the probability distribution when generating the next token. |
Version Information
.NET:
Supported in: 8.0 and newer, Core 3.1
.NET Standard:
Supported in: 2.0
.NET Framework:
Supported in: 4.5 and newer, 3.5