Migrate an on-premises Vertica database to Amazon Redshift using AWS SCT data extraction agents
Created by Sergey Dmitriev (AWS)
Environment: PoC or pilot | Source: Vertica database | Target: Amazon Redshift |
R Type: Re-architect | Technologies: Migration; Databases | AWS services: Amazon Redshift |
Summary
This pattern provides guidance for migrating an on-premises Vertica database to an Amazon Redshift cluster using AWS Schema Conversion Tool (AWS SCT) data extraction agents. An agent is an external program that is integrated with AWS SCT but performs data transformation elsewhere and interacts with other AWS services on your behalf.
Prerequisites and limitations
Prerequisites
An active AWS account
A Vertica source database used for the data warehouse workload in an on-premises data center
An Amazon Redshift target cluster
Product versions
Vertica version 7.2.2 and later. For the latest list of supported versions, see the AWS SCT documentation.
Architecture
Source technology stack
An on-premises Vertica database
Target technology stack
An Amazon Redshift cluster
Data migration architecture
Tools
AWS Schema Conversion Tool (AWS SCT) handles heterogeneous database migrations by automatically converting the source database schema and a majority of the custom code to a format that's compatible with the target database. When the source and target databases are very different from one another, you can use an AWS SCT agent to perform additional data transformation. For more information, see Migrating Data from an On-Premises Data Warehouse to Amazon Redshift in the AWS documentation.
Epics
| Task | Description | Skills required |
|---|---|---|
Validate the source and target database versions. | DBA | |
Identify storage requirements (storage type and capacity). | DBA, SysAdmin | |
Choose the proper instance type (capacity, storage features, network features). | DBA, SysAdmin | |
Identify the network-access security requirements for the source and target databases. | DBA, SysAdmin | |
Choose an application migration strategy. | DBA, SysAdmin, App owner |
| Task | Description | Skills required |
|---|---|---|
Create a virtual private cloud (VPC) and subnets. | SysAdmin | |
Create security groups. | SysAdmin | |
Configure and start an Amazon Redshift cluster. | SysAdmin |
| Task | Description | Skills required |
|---|---|---|
Migrate the data using the AWS SCT data extraction agents. | For detailed information on using AWS SCT data extraction agents, see the links in the References and Help section. | DBA |
| Task | Description | Skills required |
|---|---|---|
Follow the chosen application migration strategy. | DBA, SysAdmin, App owner |
| Task | Description | Skills required |
|---|---|---|
Switch over application clients to the new infrastructure. | DBA, SysAdmin, App owner |
| Task | Description | Skills required |
|---|---|---|
Shut down temporary AWS resources. | DBA, SysAdmin | |
Review and validate the project documents. | DBA, SysAdmin, App owner | |
Gather metrics about time to migrate, percentage of manual versus tool tasks, cost savings, etc. | DBA, SysAdmin, App owner | |
Close the project and provide any feedback. |
Related resources
References
Tutorials and videos
