Data Lake Solution
Data Lake Solution

Automated Deployment

Before you launch the automated deployment, please review the architecture, configuration, network security, and other considerations discussed in this guide. Follow the step-by-step instructions in this section to configure and deploy the data lake solution into your account.

Time to deploy: Approximately 30 minutes

What We'll Cover

The procedure for deploying this architecture on AWS consists of the following steps. For detailed instructions, follow the links for each step.

Step 1. Launch the Stack

  • Launch the AWS CloudFormation template into your AWS account.

  • Enter values for the required parameter: Stack Name, Administrator Name, Administrator Email, Cognito Domain

  • Review the other template parameters, and adjust if necessary.

Step 2. Log in to the Data Lake Console

  • Log in with the URL and temporary password sent to the Administrator email.

  • Review the solution’s online guide.

Step 1. Launch the Stack

The Amazon CloudWatch template automatically deploys the data lake solution on the AWS Cloud.

Note

You are responsible for the cost of the AWS services used while running this solution. See the Cost section for more details. For full details, see the pricing webpage for each AWS service you will be using in this solution.

  1. Log in to the AWS Management Console and click the button below to launch the data-lake-deploy AWS CloudFormation template.

    
                                Data lake solution launch button

    You can also download the template as a starting point for your own implementation.

  2. The template is launched in the US East (N. Virginia) Region by default. To launch the data lake solution in a different AWS Region, use the region selector in the console navigation bar.

    Note

    This solution uses Amazon Cognito, Amazon Athena, and AWS Glue which are currently available in specific AWS Regions only. Therefore, you must launch this solution in an AWS Region where these services are available. For the most current service availability by region, see the AWS service offerings by region.

  3. On the Select Template page, verify that you selected the correct template and choose Next.

  4. On the Specify Details page, assign a name to your data lake solution stack.

  5. Under Parameters, review the parameters for the template, and modify them as necessary.This solution uses the following default values.

    Parameter Default Description
    Administrator Name <Requires input>

    The user name for the initial solution Administrator. After the solution is deployed, this Administrator can create and manage other users, including additional Administrators.

    Administrator Email <Requires input>

    A valid email associated with the Administrator user.

    Cognito Domain <Requires input>

    Choose an available domain prefix for your Amazon Cognito hosted domain. The solution uses Amazon Cognito to offer user name and password protection for solution's Kibana. Defining a domain name for the user pool is a pre-requirement for that.

  6. Choose Next.

  7. On the Options page, you can specify tags (key-value pairs) for resources in your stack and set additional options, and then choose Next.

  8. On the Review page, review and confirm the settings. Be sure to check the box acknowledging that the template will create AWS Identity and Access Management (IAM) resources with custom names.

  9. Choose Create to deploy the stack.

    After the stack launches, the three nested stacks will be launched in the same AWS Region. Once all of the stacks and stack resources have successfully launched, you will see the message CREATE_COMPLETE. This can take 25 minutes or longer.

Step 2. Log in to the Data Lake Console

After the data lake stack launch completes the Administrator will receive an email that contains the URL to the data lake console and a temporary password.

Note

This email will be sent from no-reply@verificationemail.com. Check your email configuration to make sure you do not block or filter emails from this domain.

  1. Click the link in the email to open the solution console, and then log in with your email address and the temporary password.

  2. You will be prompted to set a new password, and then you will be signed in to the console.

  3. In the top navigation bar, choose Support to open the online guide.

Explore the guide subsections (User Guide, Admin Guide, and CLI) for specific instructions and examples.