Delivering Amazon Data Firehose streams to Apache Iceberg Tables in Amazon S3 is in preview and is subject to change.
Implement best practices with CloudWatch Alarms
Add CloudWatch alarms for when the following metrics exceed the buffering limit (a maximum of 15 minutes).
-
DeliveryToS3.DataFreshness
-
DeliveryToIceberg.DataFreshness
-
DeliveryToSplunk.DataFreshness
-
DeliveryToAmazonOpenSearchService.DataFreshness
-
DeliveryToAmazonOpenSearchServerless.DataFreshness
-
DeliveryToHttpEndpoint.DataFreshness
Also, create alarms based on the following metric math expressions.
-
approaches a percentage ofIncomingBytes
(Sum per 5 Minutes) / 300BytesPerSecondLimit
. -
approaches a percentage ofIncomingRecords
(Sum per 5 Minutes) / 300RecordsPerSecondLimit
. -
approaches a percentage ofIncomingPutRequests
(Sum per 5 Minutes) / 300PutRequestsPerSecondLimit
.
Another metric for which we recommend an alarm is
ThrottledRecords
.
For information about troubleshooting when alarms go to the ALARM
state, see Troubleshooting Amazon Data Firehose.