Monitor AI agent performance with observability and analytics
After you set up your AI agents, you can monitor their performance using AI agent observability and analytics. Connect Customer provides the following capabilities to track AI agent performance:
-
ListSpans API: Detailed span-level data about each AI agent invocation, including tool calls and nested operations. This data is available in real-time. To learn more, see ListSpans API guide.
-
GetMetricDataV2 API: Programmatic access to AI agent metrics with support for filtering and grouping. To learn more, see GetMetricDataV2 in the Connect Customer API Reference and see Metric definitions for metric definitions and calculation logic details. For the full list of AI agent metrics, see AI agent metrics.
-
Amazon Connect data lake: Raw metric data available through the Connect Customer data lake for custom reporting and analysis. To learn more, see Data type definitions. The following AI agent data lake tables are refreshed every 15 minutes:
-
CloudWatch Streaming: CloudWatch Logs into the entire AI journey including the conversation, spans, triggers, intents, recommendations, tools. To learn more, see Monitor AI agents using CloudWatch.
-
AI agent performance dashboard: Pre-built visualizations that you can access from the Connect Customer admin website by choosing Dashboard, AI agent performance dashboard. To learn more, see AI Agent performance dashboard.
