Measuring operational metrics with Amazon CloudWatch - Amazon Lex

Measuring operational metrics with Amazon CloudWatch

You can monitor Amazon Lex V2 using CloudWatch, which collects raw data and processes it into readable, near real-time metrics. These statistics are kept for 15 months, so that you can access historical information and gain a better perspective on how your web application or service is performing. You can also set alarms that watch for certain thresholds, and send notifications or take actions when those thresholds are met. For more information, see the Amazon CloudWatch User Guide.

The Amazon Lex V2 service reports the following metrics in the AWS/Lex namespace.

Metric Description

AssistedSlotResolutionModelAccessDeniedErrorCount

The number of times that Amazon Lex V2 was denied access to Amazon Bedrock

Valid dimensions for the RecognizeUtterance and StartConversation operations:

  • BotId, BotAliasId, LocaleId, Operation, InputMode, ModelType, Model

  • BotId, BotVersion, LocaleId, Operation, InputMode, ModelType, Model

Valid dimensions for RecognizeText:

  • BotId, BotAliasId, LocaleId, Operation, ModelType, Model

  • BotId, BotVersion, LocaleId, Operation, ModelType, Model

Unit: Count

AssistedSlotResolutionModelInvocationCount

The number of times that Amazon Bedrock was invoked.

Valid dimensions for the RecognizeUtterance and StartConversation operations:

  • BotId, BotAliasId, LocaleId, Operation, InputMode, ModelType, Model

  • BotId, BotVersion, LocaleId, Operation, InputMode, ModelType, Model

Valid dimensions for RecognizeText:

  • BotId, BotAliasId, LocaleId, Operation, ModelType, Model

  • BotId, BotVersion, LocaleId, Operation, ModelType, Model

Unit: Count

AssistedSlotResolutionModelSystemErrorCount

The number of times that a 5xx occured when calling Amazon Bedrock.

Valid dimensions for the RecognizeUtterance and StartConversation operations:

  • BotId, BotAliasId, LocaleId, Operation, InputMode, ModelType, Model

  • BotId, BotVersion, LocaleId, Operation, InputMode, ModelType, Model

Valid dimensions for RecognizeText:

  • BotId, BotAliasId, LocaleId, Operation, ModelType, Model

  • BotId, BotVersion, LocaleId, Operation, ModelType, Model

Unit: Count

AssistedSlotResolutionModelThrottlingErrorCount

The number of times that Amazon Lex was throttled by Amazon Bedrock.

Valid dimensions for the RecognizeUtterance and StartConversation operations:

  • BotId, BotAliasId, LocaleId, Operation, InputMode, ModelType, Model

  • BotId, BotVersion, LocaleId, Operation, InputMode, ModelType, Model

Valid dimensions for RecognizeText:

  • BotId, BotAliasId, LocaleId, Operation, ModelType, Model

  • BotId, BotVersion, LocaleId, Operation, ModelType, Model

Unit: Count

AssistedSlotResolutionResolvedSlotCount

The number of times that Amazon Bedrock returned a slot value.

Valid dimensions for the RecognizeUtterance and StartConversation operations:

  • BotId, BotAliasId, LocaleId, Operation, InputMode, ModelType, Model

  • BotId, BotVersion, LocaleId, Operation, InputMode, ModelType, Model

Valid dimensions for RecognizeText:

  • BotId, BotAliasId, LocaleId, Operation, ModelType, Model

  • BotId, BotVersion, LocaleId, Operation, ModelType, Model

Unit: Count

KendraIndexAccessError

The number of times that Amazon Lex V2 could not access your Amazon Kendra index.

  • Operation, BotId, BotAliasId, LocaleId

Unit: Count

KendraLatency

The amount of time that it takes Amazon Kendra to respond to a request from the AMAZON.KendraSearchIntent.

Valid dimensions:

  • Operation, BotId, BotVersion, LocaleId

  • Operation, BotId, BotAliasId, LocaleId

Unit: Milliseconds

KendraSuccess

The number of times that Amazon Lex V2 couldn't access your Amazon Kendra index.

Valid dimensions:

  • Operation, BotId, BotVersion, LocaleId

  • Operation, BotId, BotAliasId, LocaleId

Unit: Count

KendraSystemErrors

The number of times that Amazon Lex V2 couldn't query the Amazon Kendra index.

Valid dimensions:

  • Operation, BotId, BotAliasId, InputMode, LocaleId

Unit: Count

KendraThrottledEvents

The number of times Amazon Kendra throttled requests from the AMAZON.KendraSearchIntent.

Valid dimensions:

  • Operation, BotId, BotAliasId, InputMode. LocaleId

Unit: Count

RuntimeConcurrency

The number of concurrent connections in the specified time period. RuntimeConcurrency is reported as a StatisticSet.

Valid dimensions for the RecognizeUtterance or StartConversation operations:

  • Operation, BotId, BotVersion, InputMode, LocaleId

  • Operation, BotId, BotAliasId, InputMode, LocaleId

Valid dimensions for other operations:

  • Operation, BotId, BotVersion, LocaleId

  • Operation, BotId, BotAliasId, LocaleId

Unit: Count

RuntimeInvalidLambdaResponses

The number of invalid AWS Lambda responses in the specified period.

Valid dimensions:

  • Operation, BotId, BotAliasId, InputMode, LocaleId

Unit: Count

RuntimeLambdaErrors

The number of Lambda runtime errors in the specified time period.

Valid dimensions:

  • Operation, BotId, BotAliasId, InputMode, LocaleId

Unit: Count

RuntimePollyErrors

The number of invalid Amazon Polly responses in the specified time period.

Valid dimensions:

  • Operation, BotId, BotAliasId, InputMode, LocaleId

Unit: Count

RuntimeRequestCount

The number of runtime requests in the specified time period.

Valid dimensions for the RecognizeUtterance and StartConversation operations:

  • Operation, BotId, BotVersion, InputMode, LocaleId

  • Operation, BotId, BotAliasId, InputMode, LocaleId

Valid dimensions for other operations:

  • Operation, BotId, BotVersion, LocaleId

  • Operation, BotId, BotAliasId, LocaleId

Unit: Count

RuntimeRequestLength

Total length of a conversation with a Amazon Lex V2 bot. Only applicable to the StartConversation operation.

Valid dimensions:

  • BotAliasId, BotId, LocaleId, Operation

  • BotId, BotAliasId, LocaleId, Operation

Unit: milliseconds

RuntimeSucessfulRequestLatency

Important

This metric is RuntimeSucessfulRequestLatency and not RuntimeSuccessfulRequestLatency.

The latency for successful requests between the time the request was made and the response was passed back.

Valid dimensions for the RecognizeUtterance and StartConversation operations:

  • Operation, BotId, BotVersion, InputMode, LocaleId

  • Operation, BotId, BotAliasId, InputMode, LocaleId

Valid dimensions for other operations:

  • Operation, BotId, BotVersion, LocaleId

  • Operation, BotId, BotAliasId, LocaleId

Unit: milliseconds

RuntimeSystemErrors

The number of system errors in the specified period. The response code range for a system error is 500 to 599.

Valid dimensions for the RecognizeUtterance and StartConversation operations:

  • Operation, BotId, BotVersion, InputMode, LocaleId

  • Operation, BotId, BotAliasId, InputMode, LocaleId

Valid dimensions for other operations:

  • Operation, BotId, BotVersion, LocaleId

  • Operation, BotId, BotAliasId, LocaleId

Unit: Count

RuntimeThrottledEvents

The number of throttled events. Amazon Lex V2 throttles an event when it receives more requests than the limit of transactions per second set for your account. If the limit set for your account is frequently exceeded, you can request a limit increase. To request an increase, see AWS service limits.

Valid dimensions for the RecognizeUtterance and StartConversation operations:

  • Operation, BotId, BotVersion, InputMode, LocaleId

  • Operation, BotId, BotAliasId, InputMode, LocaleId

Valid dimensions for other operations:

  • Operation, BotId, BotVersion, LocaleId

  • Operation, BotId, BotAliasId, LocaleId

Unit: Count

RuntimeUserErrors

The number of user errors in the specified period. The response code range for a user error is 400 to 499.

Valid dimensions for the RecognizeUtterance and StartConversation operations:

  • Operation, BotId, BotVersion, InputMode, LocaleId

  • Operation, BotId, BotAliasId, InputMode, LocaleId

Valid dimensions for other operations:

  • Operation, BotId, BotVersion, LocaleId

  • Operation, BotId, BotAliasId, LocaleId

Unit: Count

The following dimensions are supported for the Amazon Lex V2 metrics.

Dimension Description
Operation

The name of the Amazon Lex V2 operation – RecognizeText, RecognizeUtterance, StartConversation, GetSession, PutSession, DeleteSession – that generated the entry.
BotId

The alphanumeric unique identifier for the bot.
BotAliasId

The alphanumeric unique identifier for the bot alias.
BotVersion

The numeric version of the bot.
InputMode

The type of input to the bot – speech, text, or DTMF.
LocaleId

The identifier of the bot's locale, such as en-US or fr-CA.
Model

Indicates the model id of the Amazon Bedrock large language model.
ModelType

Indicates the type of large language model invoked from Amazon Bedrock.