Delete evaluator

The DeleteEvaluator API permanently removes a custom evaluator and all its configuration data. This asynchronous operation is irreversible.

Deletion requirements: The evaluator must not be locked (not referenced by any enabled evaluation configurations) and must be in an Active status. Evaluators in use will return a conflict error.

Cleanup process: The system verifies no active references exist, then permanently removes the evaluator configuration. Any evaluation configurations referencing the deleted evaluator will need to be updated with alternative evaluators.

The API returns the evaluator ARN and deletion status immediately. The evaluator becomes unavailable for use once deletion completes.

Code samples for AgentCore CLI, AgentCore SDK, and AWS SDK

The following code samples demonstrate how to delete evaluators using different development approaches. Choose the method that best fits your development environment and preferences.

Example

AgentCore CLI

1. If you added the evaluator with agentcore add evaluator, remove it from the project and deploy:

   agentcore remove evaluator --name <EVALUATOR_NAME>
   agentcore deploy

   You can also run agentcore remove and choose the evaluator.

   To delete an evaluator that is not part of a project, delete it by ID:

   agentcore eval evaluator delete --id <EVALUATOR_ID>

   Note

   If the evaluator is referenced by an online evaluation configuration, you must first remove it from that configuration or delete the online evaluation configuration entirely before deleting the evaluator.

AgentCore SDK

1. from bedrock_agentcore_starter_toolkit import Evaluation
   
   eval_client = Evaluation()
   
   eval_client.delete_evaluator(evaluator_id="your_evaluator_id")

AWS SDK

1. import boto3
   
   client = boto3.client('bedrock-agentcore-control')
   
   list_configs_response = client.delete_evaluator(evaluatorId='your_evaluator_id')

AWS CLI

1. aws bedrock-agentcore-control delete-evaluator \
       --evaluator-id 'your_evaluator_id'

Console

Permanently remove a custom evaluator using the console interface, which includes confirmation prompts to prevent accidental deletion.

To delete a custom evaluator

1. Open the Amazon Bedrock AgentCore console.

2. In the navigation pane, choose Evaluation.

3. Choose Custom evaluators next to Evaluation configurations.

4. In the Custom evaluators card, view the table that lists the custom evaluators you have created.

5. Choose one of the following methods to delete the evaluator:

   • Choose the custom evaluator name to view its details, then choose Delete in the upper right of the details page.

   • Select the custom evaluator so that it is highlighted, then choose Delete at the top of the Custom evaluators card.

6. Enter confirm to confirm the deletion.

7. Choose Delete to delete the evaluator.