Setting up Amazon EMR on EKS - Amazon EMR

Setting up Amazon EMR on EKS

Complete the following tasks to get set up for Amazon EMR on EKS. If you've already signed up for Amazon Web Services (AWS) and have been using Amazon EKS, you are almost ready to use Amazon EMR on EKS. Skip any of the tasks that you've already completed.

Note

You can also follow the Amazon EMR on EKS Workshop to set up all the necessary resources to run Spark jobs on Amazon EMR on EKS. The workshop also provides automation by using CloudFormation templates to create the resources necessary for you to get started. For other templates and best practices, see our EMR Containers Best Practices Guide on GitHub.

  1. Install the AWS CLI

  2. Install eksctl

  3. Set up an Amazon EKS cluster

  4. Enable cluster access for Amazon EMR on EKS

  5. Enable IAM Roles for Service Accounts (IRSA) on the EKS cluster

  6. Create a job execution role

  7. Update the trust policy of the job execution role

  8. Grant users access to Amazon EMR on EKS

  9. Register the Amazon EKS cluster with Amazon EMR