Configuring the Amazon MWAA environment class

The environment class you choose for your Amazon MWAA environment determines the size of the AWS-managed AWS Fargate containers where the Celery Executor runs, and the AWS-managed Amazon Aurora PostgreSQL metadata database where the Apache Airflow schedulers creates task instances. This page describes each Amazon MWAA environment class, and steps to update the environment class on the Amazon MWAA console.

Environment class

The following image shows where you can update the Environment class on the Amazon MWAA console.

Apache Airflow v2

Apache Airflow v1

Environment capabilities

The following section contains the default concurrent Apache Airflow tasks, Random Access Memory (RAM), and the virtual centralized processing units (vCPUs) for each environment class. The concurrent tasks listed assume that task concurrency does not exceed the Apache Airflow Worker capacity in the environment.

mw1.small

• 5 concurrent tasks (by default)

• 1 vCPUs

• 2 GB RAM

mw1.medium

• 10 concurrent tasks (by default)

• 2 vCPUs

• 4 GB RAM

mw1.large

• 20 concurrent tasks (by default)

• 4 vCPUs

• 8 GB RAM

You can use celery.worker_autoscale to increase tasks per worker. To learn more, see the Example high performance use case.

Airflow Schedulers

The following section contains the Apache Airflow Scheduler options available on the Amazon MWAA console.

Apache Airflow v2

• v2 - Accepts between 2 to 5. Defaults to 2.

Apache Airflow v1

• v1 - Accepts 1.