Overview of migrating large data stores using AWS DMS and AWS Snowball Edge - AWS Database Migration Service

Overview of migrating large data stores using AWS DMS and AWS Snowball Edge

The process of using AWS DMS and Snowball Edge incorporates both on-premises applications and AWS-managed services. We use the terms local and remote to distinguish these components.

Local components include the following:


  • AWS DMS Agent (a local version of AWS DMS that works on-premises)

  • Snowball Edge devices

Remote components include the following:

  • Amazon S3


In the following sections, you can find a step-by-step guide to configuring, installing, and managing an AWS DMS migration using an Edge device or devices.

The following diagram shows an overview of the migration process.

				 AWS Database Migration Service and Edge device process

The migration involves a local task, where you move data to an Edge device using the DMS Agent. After an Edge device is loaded, you return it to AWS. If you have multiple Edge devices, you can return them at the same time, or in sequence. When AWS receives an Edge device, a remote task using AWS DMS loads the data to the target data store on AWS.

To migrate from a local data store to an AWS data store, you follow these steps:

  1. Use the AWS Snow Family Management Console to create a new job for importing data to S3 with a Snowball Edge Storage Optimized device. The job involves requesting the device be sent to your address.

  2. Set up AWS SCT on a local machine that can access AWS. Install the Snowball Edge client tool on a different local machine.

  3. When the Edge device arrives, power it on, connect to it, then unlock it with the client tool. For step-by-step information, see Getting started with AWS Snowball edge in the AWS Snowball Edge Developer Guide.

  4. Install the Open Database Connectivity (ODBC) drivers for your data sources. Put these on the machine with the Edge client tool.

  5. Install and configure the AWS DMS Agent host on the machine with the Edge client tool.

    The AWS DMS Agent must have connectivity to the source database, AWS SCT, AWS, and the Snowball Edge. The AWS DMS Agent is supported on the following Linux platforms only:

    • Red Hat Enterprise Linux versions 6.2 through 6.8, 7.0, and 7.1 (64-bit)

    • SUSE Linux version 12 (64-bit)

    Although the AWS DMS Agent comes in the AWS SCT installation package, it's better that they aren't located in the same place. We recommend that you install the DMS Agent on a different machine—not the machine you installed AWS SCT on.

  6. Create a new project in AWS SCT.

  7. Configure AWS SCT to use the Snowball Edge device.

  8. Register the AWS DMS Agent with AWS SCT.

  9. Create a local and AWS DMS task in SCT.

  10. Run and monitor the task in SCT.