Optimize performance for Amazon Bedrock agents using a single knowledge base - Amazon Bedrock

Optimize performance for Amazon Bedrock agents using a single knowledge base

Amazon Bedrock Agents offers options to choose different flows that can optimize on latency for simpler use cases in which agents have a single knowledge base. To ensure that your agent is able to take advantage of this optimization, check that the following conditions apply to the relevant version of your agent:

  • Your agent contains only one knowledge base.

  • Your agent contains no action groups or they are all disabled.

  • Your agent doesn't request more information from the user if it doesn't have enough information.

  • Your agent is using the default orchestration prompt template.

To learn how to check for these conditions, choose the tab for your preferred method, and then follow the steps:

Console

  1. Sign in to the AWS Management Console using an IAM role with Amazon Bedrock permissions, and open the Amazon Bedrock console at https://console.aws.amazon.com/bedrock/.

  2. Select Agents from the left navigation pane. Then, choose an agent in the Agents section.

  3. In the Agent overview section, check that the User input field is DISABLED.

  4. If you're checking if the optimization is being applied to the working draft of the agent, select the Working draft in the Working draft section. If you're checking if the optimization is being applied to a version of the agent, select the version in the Versions section.

  5. Check that the Knowledge bases section contains only one knowledge base. If there's more than one knowledge base, disable all of them except for one. To learn how to disable knowledge bases, see Disassociate a knowledge base from an agent.

  6. Check that the Action groups section contains no action groups. If there are action groups, disable all of them. To learn how to disable action groups, see Modify an action group.

  7. In the Advanced prompts section, check that the Orchestration field value is Default. If it's Overridden, choose Edit (if you're viewing a version of your agent, you must first navigate to the working draft) and do the following:

    1. In the Advanced prompts section, select the Orchestration tab.

    2. If you revert the template to the default settings, your custom prompt template will be deleted. Make sure to save your template if you need it later.

    3. Clear Override orchestration template defaults. Confirm the message that appears.

  8. To apply any changes you've made, select Prepare at the top of the Agent details page or in the test window. Then, test the agent's optimized performance by submitting a message in the test window.

  9. (Optional) If necessary, create a new version of your agent by following the steps at Deploy and integrate an Amazon Bedrock agent into your application.

API

  1. Send a ListAgentKnowledgeBases request with an Agents for Amazon Bedrock build-time endpoint and specify the ID of your agent. For the agentVersion, use DRAFT for the working draft or specify the relevant version. In the response, check that agentKnowledgeBaseSummaries contains only one object (corresponding to one knowledge base). If there's more than one knowledge base, disable all of them except for one. To learn how to disable knowledge bases, see Disassociate a knowledge base from an agent.

  2. Send a ListAgentActionGroups request with an Agents for Amazon Bedrock build-time endpoint and specify the ID of your agent. For the agentVersion, use DRAFT for the working draft or specify the relevant version. In the response, check that the actionGroupSummaries list is empty. If there are action groups, disable all of them. To learn how to disable action groups, see Modify an action group.

  3. Send a GetAgent request with an Agents for Amazon Bedrock build-time endpoint and specify the ID of your agent. In the response, within the promptConfigurations list in the promptOverrideConfiguration field, look for the PromptConfiguration object whose promptType value is ORCHESTRATION. If the promptCreationMode value is DEFAULT, you don't have to do anything. If it's OVERRIDDEN, do the following to revert the template to the default settings:

    1. If you revert the template to the default settings, your custom prompt template will be deleted. Make sure to save your template from the basePromptTemplate field if you need it later.

    2. Send an UpdateAgent request with an Agents for Amazon Bedrock build-time endpoint. For the PromptConfiguration object corresponding to the orchestration template, set the value of promptCreationMode to DEFAULT.

  4. To apply any changes you've made, send a PrepareAgent request with an Agents for Amazon Bedrock build-time endpoint. Then, test the agent's optimized performance by submitting an InvokeAgent request with an Agents for Amazon Bedrock runtime endpoint, using the TSTALIASID alias of the agent.

  5. (Optional) If necessary, create a new version of your agent by following the steps at Deploy and integrate an Amazon Bedrock agent into your application.