Menu
AWS Data Pipeline
Developer Guide (API Version 2012-10-29)

Incremental Copy of an Amazon RDS MySQL Table to Amazon Redshift

The Incremental copy of Amazon RDS MySQL table to Amazon Redshift template copies data from an Amazon RDS MySQL table to an Amazon Redshifttable by staging data in an Amazon S3 folder. The Amazon S3 staging folder must be in the same region as the Amazon Redshift cluster. AWS Data Pipeline uses a translation script to create an Amazon Redshift table with the same schema as the source Amazon RDS MySQL table if it does not already exist. You must provide any Amazon RDS MySQL to Amazon Redshift column data type overrides you would like to apply during Amazon Redshift table creation. This template copies changes that are made to the Amazon RDS MySQL table between scheduled intervals, starting from the scheduled start time. Physical deletes to the Amazon RDS MySQL table are not copied. You must provide the column name that stores the last modified time value.

The template uses the following pipeline objects:

  • RDSToS3CopyActivity

  • CopyActivity

  • RedshiftCopyActivity

  • S3DataNode

  • SqlDataNode

  • RedshiftDataNode

  • RedshiftDatabase