Menu
Amazon Kinesis Firehose
Developer Guide

Monitoring Kinesis Agent Health

Kinesis Agent publishes custom CloudWatch metrics with a namespace of AWSKinesisAgent to help assess if the agent is healthy, submitting data into Kinesis Firehose as specified, and consuming the appropriate amount of CPU and memory resources on the data producer.

Metrics such as number of records and bytes sent are useful to understand the rate at which the agent is submitting data to the Kinesis Firehose delivery stream. When these metrics fall below expected thresholds by some percentage or drop to zero, it could indicate configuration issues, network errors, or agent health issues. Metrics such as on-host CPU and memory consumption and agent error counters indicate data producer resource usage, and provide insights into potential configuration or host errors. Finally, the agent also logs service exceptions to help investigate agent issues.

The agent metrics are reported in the region specified in the agent configuration setting cloudwatch.endpoint. For more information, see Agent Configuration Settings.

There is a nominal charge for metrics emitted from Kinesis Agent, which are enabled by default. For more information, see Amazon CloudWatch Pricing.

Monitoring with CloudWatch

Kinesis Agent sends the following metrics to CloudWatch.

Metric Description
BytesSent

The number of bytes sent to the Kinesis Firehose delivery stream over the specified time period.

Units: Bytes

RecordSendAttempts

The number of records attempted (either first time, or as a retry) in a call to PutRecordBatch over the specified time period.

Units: Count

RecordSendErrors

The number of records that returned failure status in a call to PutRecordBatch, including retries, over the specified time period.

Units: Count

ServiceErrors

The number of calls to PutRecordBatch that resulted in a service error (other than a throttling error) over the specified time period.

Units: Count