Ingest high-cardinality logs to generate metrics with CloudWatch embedded metric format
The CloudWatch embedded metric format enables you to ingest complex high-cardinality application data in the form of logs and to generate actionable metrics from them. You can embed custom metrics alongside detailed log event data, and CloudWatch automatically extracts the custom metrics so that you can visualize and alarm on them, for real-time incident detection. Additionally, the detailed log events associated with the extracted metrics can be queried using CloudWatch Logs Insights to provide deep insights into the root causes of operational events.
Embedded metric format helps you generate actionable custom metrics from ephemeral resources such as Lambda functions and containers. By using the embedded metric format to send logs from these ephemeral resources, you can now easily create custom metrics without having to instrument or maintain separate code, while gaining powerful analytical capabilities on your log data.
When using the embedded metric format, you can generate your logs using a client library— for more information, see Using the client libraries to generate embedded metric format logs. Alternatively, you can manually construct the logs and submit them using the PutLogEvents API or the CloudWatch agent.
Charges are incurred for logs ingestion and archival, and custom metrics that are generated. For more information, see Amazon CloudWatch
Pricing
Note
Be careful when configuring your metric extraction as it impacts your custom metric usage and corresponding bill.
If you unintentionally create metrics based on high-cardinality dimensions (such as requestId), the embedded metric format will by design create
a custom metric corresponding to each unique dimension combination. For more information, see Dimensions.
Topics
