Menu
Data Lake Solution
Data Lake Solution

Automated Deployment

Before you launch the automated deployment, please review the architecture, configuration, network security, and other considerations discussed in this guide. Follow the step-by-step instructions in this section to configure and deploy the data lake solution into your account.

Time to deploy: Approximately 30 minutes

What We'll Cover

The procedure for deploying this architecture on AWS consists of the following steps. For detailed instructions, follow the links for each step.

Step 1. Launch the Stack

  • Launch the AWS CloudFormation template into your AWS account.

  • Enter values for the required parameter: Stack Name, Administrator Name, Administrator Email, and Access IP Address.

  • Review the other template parameters, and adjust if necessary.

Step 2. Log in to the Data Lake Console

  • Log in with the URL and temporary password sent to the Administrator email.

  • Review the solution’s online guide.

Step 1. Launch the Stack

The Amazon CloudWatch template automatically deploys the data lake solution on the AWS Cloud.

Note

You are responsible for the cost of the AWS services used while running this solution. See the Cost section for more details. For full details, see the pricing webpage for each AWS service you will be using in this solution.

  1. Log in to the AWS Management Console and click the button below to launch the data-lake-deploy AWS CloudFormation template.

    
                                Data lake solution launch button

    You can also download the template as a starting point for your own implementation.

  2. The template is launched in the US East (N. Virginia) Region by default. To launch the data lake solution in a different AWS Region, use the region selector in the console navigation bar.

    Note

    This solution uses AWS Lambda and Amazon Cognito which are currently available in specific AWS Regions only, therefore you must launch this solution in an AWS Region where these services are available. For the most current service availability by region, see the AWS service offerings by region.

  3. On the Select Template page, verify that you selected the correct template and choose Next.

  4. On the Specify Details page, assign a name to your data lake solution stack.

  5. Under Parameters, review the parameters for the template, and modify them as necessary.

    Note

    The Lambda function checks your current preferences in Amazon DynamoDB each time it runs, so you can manually modify these values at any time.

    This solution uses the following default values.

    Parameter Default Description
    Administrator Name <Requires input>

    The user name for the initial solution Administrator. After the solution is deployed, this Administrator can create and manage other users, including additional Administrators.

    Administrator Email <Requires input>

    A valid email associated with the Administrator user.

    Access IP Address <Requires input>

    The source IP address of the Administrator(s) who can access Amazon ES cluster to perform any necessary management functions.

    Send Anonymous Usage Data Yes Send anonymous data to AWS to help us understand solution usage and related cost savings across our customer base as a whole. To opt out of this feature, choose No. For more information, see Appendix B.
  6. Choose Next.

  7. On the Options page, you can specify tags (key-value pairs) for resources in your stack and set additional options, and then choose Next.

  8. On the Review page, review and confirm the settings. Be sure to check the box acknowledging that the template will create AWS Identity and Access Management (IAM) resources with custom names.

  9. Choose Create to deploy the stack.

    After the stack launches, the three nested stacks will be launched in the same AWS Region. Once all of the stacks and stack resources have successfully launched, you will see the message CREATE_COMPLETE. This can take 25 minutes or longer.

Step 2. Log in to the Data Lake Console

After the data lake stack launch completes the Administrator will receive an email that contains the URL to the data lake console and a temporary password.

Note

This email will be sent from no-reply@verificationemail.com. Check your email configuration to make sure you do not block or filter emails from this domain.

  1. Click the link in the email to open the solution console, and then log in with your email address and the temporary password.

  2. You will be prompted to set a new password, and then you will be signed in to the console.

  3. In the top navigation bar, choose Support to open the online guide.

Explore the guide subsections (User Guide, Admin Guide, and CLI) for specific instructions and examples.