Class: Aws::BedrockAgentCoreControl::Types::LlmAsAJudgeEvaluatorConfig

Inherits:
Struct
  • Object
show all
Defined in:
gems/aws-sdk-bedrockagentcorecontrol/lib/aws-sdk-bedrockagentcorecontrol/types.rb

Overview

The configuration for LLM-as-a-Judge evaluation that uses a language model to assess agent performance based on custom instructions and rating scales.

See Also:

Constant Summary collapse

SENSITIVE = 
[:instructions, :rating_scale]

Instance Attribute Summary collapse

Instance Attribute Details

#instructions ⇒ String

The evaluation instructions that guide the language model in assessing agent performance, including criteria and evaluation guidelines.

Returns:

  • (String) 


10941
10942
10943
10944
10945
10946
10947
 
# File 'gems/aws-sdk-bedrockagentcorecontrol/lib/aws-sdk-bedrockagentcorecontrol/types.rb', line 10941

class LlmAsAJudgeEvaluatorConfig < Struct.new(
  :instructions,
  :rating_scale,
  :model_config)
  SENSITIVE = [:instructions, :rating_scale]
  include Aws::Structure
end

#model_config ⇒ Types::EvaluatorModelConfig

The model configuration that specifies which foundation model to use and how to configure it for evaluation.

Returns:



10941
10942
10943
10944
10945
10946
10947
 
# File 'gems/aws-sdk-bedrockagentcorecontrol/lib/aws-sdk-bedrockagentcorecontrol/types.rb', line 10941

class LlmAsAJudgeEvaluatorConfig < Struct.new(
  :instructions,
  :rating_scale,
  :model_config)
  SENSITIVE = [:instructions, :rating_scale]
  include Aws::Structure
end

#rating_scale ⇒ Types::RatingScale

The rating scale that defines how the evaluator should score agent performance, either numerical or categorical.

Returns:



10941
10942
10943
10944
10945
10946
10947
 
# File 'gems/aws-sdk-bedrockagentcorecontrol/lib/aws-sdk-bedrockagentcorecontrol/types.rb', line 10941

class LlmAsAJudgeEvaluatorConfig < Struct.new(
  :instructions,
  :rating_scale,
  :model_config)
  SENSITIVE = [:instructions, :rating_scale]
  include Aws::Structure
end