Data Lake Solution
Data Lake Solution

Solution Features

This data lake solution provides the following features:

  • Data lake reference implementation: Leverage this data lake solution out-of-the-box, or as a reference implementation that you can customize to meet unique data management, search, and processing needs.

  • User interface: The solution automatically creates an intuitive, web-based console UI hosted on Amazon S3 and delivered by Amazon CloudFront. Access the console to easily manage data lake users, data lake policies, add or remove data packages, search data packages, and create manifests of datasets for additional analysis.

  • Command line interface: Use the provided CLI or API to easily automate data lake activities or integrate this solution into existing data automation for dataset ingress, egress, and analysis.

  • Managed storage layer: Secure and manage the storage and retrieval of data in a managed Amazon S3 bucket, and use a solution-specific AWS Key Management Service (KMS) key to encrypt data at rest.

  • Data access flexibility: Leverage pre-signed Amazon S3 URLs, or use an appropriate AWS Identity and Access Management (IAM) role for controlled yet direct access to datasets in Amazon S3.

  • Data transformation and analysis: Upload datasets with searchable metadata that integrates with AWS Glue and Amazon Athena to transform and analyze the data.

  • Federation sign in: Optionally, you can enable users to sign in through a SAML identity provider (IdP) such as Microsoft Active Directory Federation Services (AD FS).