Migrate an Oracle database to Amazon RDS for Oracle by using Oracle GoldenGate flat file adapters
Created by Dhairya Jindani (AWS) and Baji Shaik (AWS)
Environment: PoC or pilot | Source: An Oracle database (on-premises or on an EC2 instance) | Target: Amazon RDS for Oracle |
R Type: Replatform | Workload: Oracle | Technologies: Migration; Analytics; Databases |
AWS services: Amazon RDS |
Summary
Oracle GoldenGate is a real-time data capture and replication service for heterogeneous databases and IT environments. However, this service doesn’t currently support Amazon Relational Database Service (Amazon RDS) for Oracle. For a list of supported databases, see Oracle GoldenGate for Heterogeneous Databases
In this pattern, you use Oracle GoldenGate to extract the trail files from your source Oracle database. The data pump copies the trail files to an integration server, which is an EC2 instance. On the integration server, Oracle GoldenGate uses the flat file adapter to generate a series of sequential flat files based on the transational data capture of the trail files.Oracle GoldenGate formats the data as either delimiter-separated values or length-delimited values. You then use Oracle SQL*Loader to import the flat files into the target Amazon RDS for Oracle database instance.
Target audience
This pattern is intended for those who have experience with and knowledge of an Oracle GoldenGate's fundamental building blocks. For more information, see Overview of the Oracle GoldenGate Architecture
Prerequisites and limitations
Prerequisites
An active Amazon Web Services (AWS) account.
An Oracle GoldenGate license.
A separate license for an Oracle GoldenGate adapter.
A source Oracle database, either running on-premises or on an EC2 instance.
An EC2 Linux instance that is used as the integration server. For more information, see Get started with Amazon EC2 Linux instances (Amazon EC2 documentation).
A target Amazon RDS for Oracle database instance. For more information, see Creating an Oracle DB instance (Amazon RDS documentation).
Product versions
Oracle Database Enterprise Edition version 10g, 11g, 12c, or later
Oracle GoldenGate version 12.2.0.1.1 or later
Architecture
Source technology stack
An Oracle database (on premises or on an EC2 instance)
Target technology stack
Amazon RDS for Oracle
Source and target architecture
Oracle GoldenGate extracts trails from the source database logs.
The data pump extracts the trails and migrates them to an integration server.
The Oracle GoldenGate flat file adapter reads the trails, source definitions, and extract parameters.
You exit the extraction, which generates a control file and flat data files.
You migrate the flat data files to an Amazon RDS for Oracle database instance in the AWS Cloud.
Tools
AWS services
Amazon Elastic Compute Cloud (Amazon EC2) provides scalable computing capacity in the AWS Cloud. You can launch as many virtual servers as you need and quickly scale them up or down.
Amazon Relational Database Service (Amazon RDS) for Oracle helps you set up, operate, and scale an Oracle relational database in the AWS Cloud.
Other services
Oracle GoldenGate
is a service that helps you to replicate, filter, and transform data from one database to another heterogeneous database or to another target topology, such as flat files. Oracle GoldenGate application adapters
enable Oracle GoldenGate to produce a series of sequential flat files and control files from transactional data captured in the trail files of a source database. These adapters are widely used for extract, transform, and load (ETL) operations in data warehouse applications and proprietary or legacy applications. Oracle GoldenGate performs this capture and applies it in near real-time across heterogeneous databases, platforms, and operating systems. The adapters support different formats for the output files, such as CSV or Apache Parquet. You can load these generated files in order to load the data into different heterogeneous databases.
Epics
| Task | Description | Skills required |
|---|---|---|
Download Oracle GoldenGate. | On the source database server, download Oracle GoldenGate version 12.2.0.1.1 or later. For instructions, see Downloading Oracle GoldenGate | DBA |
Install Oracle GoldenGate. | For instructions, see Installing Oracle GoldenGate | DBA |
Set up Oracle GoldenGate. | For instructions, see Preparing the Database for Oracle GoldenGate | DBA |
| Task | Description | Skills required |
|---|---|---|
Download Oracle GoldenGate. | On the integration server, download Oracle GoldenGate version 12.2.0.1.1 or later. For instructions, see Downloading Oracle GoldenGate | DBA |
Install Oracle GoldenGate. | Create directories, set up the manager process, and create the | DBA |
| Task | Description | Skills required |
|---|---|---|
Prepare the Oracle GoldenGate adapters. | On the integration server, set up the Oracle GoldenGate adapter software. Do the following:
| DBA |
Configure the data pump. | On the source server, configure the data pump to transfer the trail file from the source server to the integration server. Create the data pump parameter file and trails file directory. For instructions, see Configuring the Flat File Adapter | DBA |
| Task | Description | Skills required |
|---|---|---|
Generate the flat files. | Create the extract file and control file, and then start the extraction process on the integration server. This extracts the database changes and writes the source database to the flat files. For instructions, see Using the Flat File Adapter | DBA |
Load the flat files to the target database. | Load the flat files into the target Amazon RDS for Oracle database instance. For more information, see Importing using Oracle SQL*Loader (Amazon RDS documentation). | DBA |
Troubleshooting
| Issue | Solution |
|---|---|
The Oracle GoldenGate flat file adapter generates an error. | For a description of the adapter errors, see Locating Error Messages |
Related resources
Installing Oracle GoldenGate
(Oracle documentation) Configuring Oracle GoldenGate
(Oracle documentation) Understanding Oracle GoldenGate Adapters
(Oracle documentation) Configuring the Flat File Adapter
(Oracle documentation)
