Menu
AWS Glue
Developer Guide

Triggering Jobs in AWS Glue

You decide what triggers an extract, transform, and load (ETL) job to run in AWS Glue. The triggering condition can be based on a schedule (as defined by a cron expression) or on an event. You can also run a job on demand.

Triggering Jobs Based on Schedules or Events

When you create a trigger for a job based on a schedule, you can specify constraints, such as the frequency the job runs, which days of the week it runs, and at what time. These constraints are based on cron. When you're setting up a schedule for a trigger, you should consider the features and limitations of cron. For example, if you choose to run your crawler on day 31 each month, keep in mind that some months don't have 31 days. For more information about cron, see Time-Based Schedules for Jobs and Crawlers.

When you create a trigger based on an event, you specify which events cause the trigger to fire, such as when another job completes. For a jobs completed trigger, you specify a list of jobs that cause a trigger to fire when they complete. In turn, when the trigger fires, it starts a run of any dependent jobs.

Defining Trigger Types

A trigger can be one of the following types:

Schedule

A time-based trigger based on cron.

Jobs completed

An event-based trigger based on a previous job or multiple jobs completing. This trigger fires on completion of these jobs.

On-demand

The trigger fires when you start it. As jobs complete, any triggers watching for completion are also fired and dependent jobs are started.

For more information about defining triggers using the AWS Glue console, see Working with Triggers on the AWS Glue Console.