Cloudera EDH on AWS
Cloudera EDH Quick Start

Deployment Steps

This Quick Start enables you to set up a fully customizable Hadoop cluster on demand. Building a scalable, on-demand infrastructure on AWS provides a cost-effective solution for handling large-scale compute and storage requirements.

This Quick Start uses Cloudera Director, which helps enable the delivery of an enterprise-class, elastic, self-service experience for the Enterprise Data Hub on a cloud infrastructure. The flexible architecture allows you to choose the most appropriate network, compute, and storage infrastructure for your environment. You can deploy the Quick Start into an existing VPC or create a new VPC for the Cloudera EDH cluster.

What We'll Cover

The procedure for deploying Cloudera EDH on AWS consists of the following steps. For detailed instructions, follow the links for each step.

  • Step 1. Prepare an AWS account

    This involves signing up for an AWS account, choosing a region, creating a key pair, and requesting increases for account limits, if necessary.

  • Step 2. Launch the Quick Start

    In this step, you’ll launch the AWS CloudFormation template into your AWS account, specify parameter values, and create the stack. The Quick Start provides separate templates for end-to-end deployment and deployment into an existing VPC.

  • Step 3. Configure the cluster and EDH services

    This step involves customizing the EDH deployment by choosing private or public subnets, EC2 instance types, the number of nodes in the cluster, and other parameters. Cloudera Director server provides a simple user interface to build complex topologies, and includes features such as dynamic scaling, cloning, and repeated deployments on AWS. Starting with the release of Cloudera Director 1.5.1, you can access the Cloudera Director server UI in a browser, without having to connect to any of the instances by using SSH. You can provision complex deployments that involve multiple instance types, security groups, placement groups, and other features by using this web interface. See the Cloudera Director documentation for additional details.

    Note

    Previous versions of Cloudera Director required modifying the configuration files aws.simple.conf and aws.reference.conf by connecting via SSH to the launcher nodes. This is no longer necessary.

  • Step 4. Deploy the EDH cluster

    In this step, you will configure your cluster and launch the cluster by using the Cloudera Director server web UI. The reference deployment installs both the Cloudera Director client and the Cloudera Director server on the cluster launcher node. Optionally, you may connect to the launcher node by using SSH to modify or deploy the cluster via the Cloudera Director client.

On this page: