Class: Aws::BedrockAgentCoreControl::Types::InferenceConfiguration

Inherits:

Struct

• Object
• Struct
• Aws::BedrockAgentCoreControl::Types::InferenceConfiguration

Defined in:

gems/aws-sdk-bedrockagentcorecontrol/lib/aws-sdk-bedrockagentcorecontrol/types.rb

Overview

The configuration parameters that control how the foundation model behaves during evaluation, including response generation settings.

See Also:

• AWS API Documentation

Constant Summary

SENSITIVE =

[]

Instance Attribute Summary

• #max_tokens ⇒ Integer

  The maximum number of tokens to generate in the model response during evaluation.

• #stop_sequences ⇒ Array<String>

  The list of sequences that will cause the model to stop generating tokens when encountered.

• #temperature ⇒ Float

  The temperature value that controls randomness in the model's responses.

• #top_p ⇒ Float

  The top-p sampling parameter that controls the diversity of the model's responses by limiting the cumulative probability of token choices.

Instance Attribute Details

#max_tokens ⇒ Integer

The maximum number of tokens to generate in the model response during evaluation.

Returns:

• (Integer)

# File 'gems/aws-sdk-bedrockagentcorecontrol/lib/aws-sdk-bedrockagentcorecontrol/types.rb', line 5448

class InferenceConfiguration < Struct.new(
  :max_tokens,
  :temperature,
  :top_p,
  :stop_sequences)
  SENSITIVE = []
  include Aws::Structure
end

#stop_sequences ⇒ Array<String>

The list of sequences that will cause the model to stop generating tokens when encountered.

Returns:

• (Array<String>)

# File 'gems/aws-sdk-bedrockagentcorecontrol/lib/aws-sdk-bedrockagentcorecontrol/types.rb', line 5448

class InferenceConfiguration < Struct.new(
  :max_tokens,
  :temperature,
  :top_p,
  :stop_sequences)
  SENSITIVE = []
  include Aws::Structure
end

#temperature ⇒ Float

The temperature value that controls randomness in the model's responses. Lower values produce more deterministic outputs.

Returns:

• (Float)

# File 'gems/aws-sdk-bedrockagentcorecontrol/lib/aws-sdk-bedrockagentcorecontrol/types.rb', line 5448

class InferenceConfiguration < Struct.new(
  :max_tokens,
  :temperature,
  :top_p,
  :stop_sequences)
  SENSITIVE = []
  include Aws::Structure
end

#top_p ⇒ Float

The top-p sampling parameter that controls the diversity of the model's responses by limiting the cumulative probability of token choices.

Returns:

• (Float)

# File 'gems/aws-sdk-bedrockagentcorecontrol/lib/aws-sdk-bedrockagentcorecontrol/types.rb', line 5448

class InferenceConfiguration < Struct.new(
  :max_tokens,
  :temperature,
  :top_p,
  :stop_sequences)
  SENSITIVE = []
  include Aws::Structure
end