Monitoring progress with replication metrics and Amazon S3 event notifications

S3 replication metrics provide detailed metrics for the replication rules in your replication configuration. With replication metrics, you can monitor minute-by-minute progress of replication by tracking bytes pending, operations pending, and replication latency. Additionally, you can set up Amazon S3 Event Notifications to receive replication failure events to assist in troubleshooting any configuration issues.

When enabled, S3 replication metrics publish the following metrics to Amazon CloudWatch:

Bytes Pending Replication—The total number of bytes of objects pending replication for a given replication rule.

Replication Latency—The maximum number of seconds by which the replication destination buckets are behind the source bucket for a given replication rule.

Operations Pending Replication—The number of operations pending replication for a given replication rule. Operations include objects, delete markers, tags, ACLs, and Object Lock operations.

Note

S3 replication metrics are billed at the same rate as Amazon CloudWatch custom metrics. For information, see Amazon CloudWatch pricing.

S3 replication metrics are turned on automatically when you enable S3 Replication Time Control (S3 RTC). S3 RTC includes other features such as a service level agreement (SLA) and notifications for missed thresholds. For more information, see Meeting compliance requirements using S3 Replication Time Control (S3 RTC).

Topics

• Enabling S3 replication metrics
• Receiving replication failure events with Amazon S3 event notifications
• Viewing replication metrics using the Amazon S3 console

Enabling S3 replication metrics

You can start using S3 replication metrics with a new or existing replication rule. You can choose to apply your replication rule to an entire S3 bucket, or to Amazon S3 objects with a specific prefix or tag.

This topic provides instructions for enabling S3 replication metrics in your replication configuration when buckets are owned by the same or different AWS accounts.

To enable replication metrics using the AWS Command Line Interface (AWS CLI), you must add a replication configuration to the source bucket with Metrics enabled. In this example configuration, objects under the prefix Tax are replicated to the destination bucket DOC-EXAMPLE-BUCKET, and metrics are generated for those objects.

{
    "Rules": [
        {
            "Status": "Enabled",
            "Filter": {
                "Prefix": "Tax"
            },
            "Destination": {
                "Bucket": "arn:aws:s3:::DOC-EXAMPLE-BUCKET",
                "Metrics": {
                    "Status": "Enabled"
                }
            },
            "Priority": 1
        }
    ],
    "Role": "IAM-Role-ARN"
}

For full instructions on creating replication rules, see Configuring replication for source and destination buckets owned by the same account.

For more information about viewing replication metrics in the S3 console, see Viewing replication metrics using the Amazon S3 console.

Receiving replication failure events with Amazon S3 event notifications

Amazon S3 event notifications can notify you in the rare instance when objects do not replicate to their destination Region. Amazon S3 events are available through Amazon Simple Queue Service (Amazon SQS), Amazon Simple Notification Service (Amazon SNS), or AWS Lambda. For more information, see Configuring Amazon S3 event notifications.