Setting up permissions for open table storage formats in Lake Formation

AWS Lake Formation supports managing access permissions for Open Table Formats (OTFs) such as Apache Iceberg, Apache Hudi, and Linux foundation Delta Lake. In this tutorial, you'll learn how to create Iceberg, Hudi, and Delta Lake with symlink manifest tables in the AWS Glue Data Catalog using AWS Glue, set up fine-grained permissions using Lake Formation, and query data using Amazon Athena.

Note

AWS analytics services don't support all transactional table formats. For more information, see Working with other AWS services. This tutorial manually covers creating a new database and a table in the Data Catalog using AWS Glue jobs only.

This tutorial includes an AWS CloudFormation template for quick setup. You can review and customize it to suit your needs.

Topics

• Intended audience
• Prerequisites
• Step 1: Provision your resources
• Step 2: Set up permissions for an Iceberg table
• Step 3: Set up permissions for a Hudi table
• Step 4: Set up permissions for a Delta Lake table
• Step 5: Clean up AWS resources