Code examples for Amazon Managed Workflows for Apache Airflow

This guide contains code samples, including DAGs and custom plugins, that you can use on an Amazon Managed Workflows for Apache Airflow environment. For more examples of using Apache Airflow with AWS services, refer to the dags directory in the Apache Airflow GitHub repository.

Samples

• Using a DAG to import variables in the CLI

• Creating an SSH connection using the SSHOperator

• Using a secret key in AWS Secrets Manager for an Apache Airflow Snowflake connection

• Using a DAG to write custom metrics in CloudWatch

• Aurora PostgreSQL database cleanup on an Amazon MWAA environment

• Exporting environment metadata to CSV files on Amazon S3

• Using a secret key in AWS Secrets Manager for an Apache Airflow variable

• Using a secret key in AWS Secrets Manager for an Apache Airflow connection

• Creating a custom plugin with Oracle

• Changing a DAG's timezone on Amazon MWAA

• Refreshing a CodeArtifact token

• Creating a custom plugin with Apache Hive and Hadoop

• Invoking DAGs with a Lambda function

• Invoking DAGs in different Amazon MWAA environments

• Using Amazon MWAA with Amazon RDS for Microsoft SQL Server

• Using Amazon MWAA with Amazon EKS

• Connecting to Amazon ECS using the ECSOperator

• Using dbt with Amazon MWAA

• AWS blogs and tutorials

AWS blogs and tutorials

• Working with Amazon EKS and Amazon MWAA for Apache Airflow v2.x