Monitoring with CloudWatch - AWS Deadline Cloud

Monitoring with CloudWatch

Amazon CloudWatch (CloudWatch) collects raw data and processes it into readable, near real-time metrics. You can open the CloudWatch console at https://console.aws.amazon.com/cloudwatch/ to view and filter Deadline Cloud metrics.

  • In a Deadline Cloud customer-managed fleet, CloudWatch sends you two metrics UnhealthyWorkerCount and RecommendedFleetSize:

  • The namespace for these metrics is AWS/DeadlineCloud.

  • You can use the dimensions farmID and fleetID to filter metrics.

  • Both metrics use the unit count.

These statistics are kept for 15 months so you can access historical information to gain a better perspective on how your web application or service is performing. You can also set alarms that watch for certain thresholds, and send notifications or take actions when those thresholds are met. For more information, see the Amazon CloudWatch User Guide.

Deadline Cloud has two kinds of logs – task logs and worker logs. A task log is when you run execution logs as a script or as DCC runs. A task log might show events such as assets loading, tiles rendering, or textures not being found.

A worker log shows worker agent processes. These might include things such as when the worker agents starts up, registers itself, reports progress, loads configurations, or completes tasks.

For Deadline Cloud, workers upload these logs to CloudWatch Logs. By default, logs never expire. If a job outputs a high volume of data, you can incur extra costs. For more information, see Amazon CloudWatch pricing.

You can adjust the retention policy for each log group. A shorter retention removes old logs and can help reduce storage costs. To keep logs, you can archive them to Amazon Simple Storage Service before removing the log. For more information, see Export log data to Amazon S3 using the console in the Amazon CloudWatch user guide.

Note

CloudWatch log reads are limited by AWS. If you plan to onboard many artists, we suggest you contact AWS customer support and request an increase for the GetLogEvents quota in CloudWatch. Additionally, we recommend you close the log tailing portal when you are not debugging.

For more information, see CloudWatch Logs quotas in the Amazon CloudWatch user guide.