ExternalSourcesGenerationConfiguration¶
Structure Class¶
ExternalSourcesGenerationConfiguration
dataclass
¶
Contains the generation configuration of the external source wrapper object.
Attributes¶
additional_model_request_fields
class-attribute
instance-attribute
¶
Additional model parameters and their corresponding values not included in the textInferenceConfig structure for an external source. Takes in custom model parameters specific to the language model being used.
guardrail_configuration
class-attribute
instance-attribute
¶
guardrail_configuration: GuardrailConfiguration | None = None
The configuration details for the guardrail.
inference_config
class-attribute
instance-attribute
¶
inference_config: InferenceConfig | None = None
Configuration settings for inference when using RetrieveAndGenerate to generate responses while using an external source.
performance_config
class-attribute
instance-attribute
¶
performance_config: PerformanceConfiguration | None = None
The latency configuration for the model.
prompt_template
class-attribute
instance-attribute
¶
prompt_template: PromptTemplate | None = None
Contain the textPromptTemplate string for the external source wrapper object.