Start an AWS Glue job with Step Functions

Learn to use Step Functions to start a job run on AWS Glue. This page lists the supported API actions and provides an example Task state to start a AWS Glue job.

Step Functions can control certain AWS services directly from Amazon States Language (ASL). To learn more, see Integrating other services and Passing parameters to a service API in Step Functions.

How the Optimized AWS Glue integration is different than the AWS GlueAWS SDK integration

• The Run a Job (.sync) integration pattern is available.

• The JobName field is extracted from the request and inserted into the response, which normally only contains JobRunID.

Supported AWS Glue API:

• StartJobRun

Parameters in Step Functions are expressed in PascalCase

Even if the native service API is in camelCase, for example the API action startSyncExecution, you specify parameters in PascalCase, such as: StateMachineArn.

The following includes a Task state that starts an AWS Glue job.

"Glue StartJobRun": {
      "Type": "Task",
      "Resource": "arn:aws:states:::glue:startJobRun.sync",
      "Parameters": {
        "JobName": "GlueJob-JTrRO5l98qMG"
      },
      "Next": "ValidateOutput"
    },

For information about how to configure IAM permissions when using Step Functions with other AWS services, see How Step Functions generates IAM policies for integrated services.