Using AWS Glue with Amazon DynamoDB as source and sink - AWS Prescriptive Guidance

Using AWS Glue with Amazon DynamoDB as source and sink

This solution is more basic than the one that uses the Amazon DynamoDB export feature, and it can be used for smaller datasets. This solution reads directly from the source table and writes directly to the target table. It doesn’t require the intermediate storage on Amazon S3. It doesn't need to infer the source schema.

The solution requires creating an AWS Glue job with the source DynamoDB table as the source and the target DynamoDB table as the sink.


            AWS Glue reads the database in the source account and writes to the database in the target account.

For more information, see Cross-account replication with Amazon DynamoDB.

Advantages

  • It's a serverless solution.

  • AWS Glue is the only additional AWS service required, and AWS Glue supports scheduling the ETL jobs.

  • Unlike the export solution, this solution does not require keeping up with schema changes.

Drawbacks

  • The solution consumes provisioned throughput on the source and the target tables, which can affect performance and availability.