Start an AWS Glue job with Step Functions
Learn to use Step Functions to start a job run on AWS Glue. This page lists the supported API actions and provides an
example Task
state to start a AWS Glue job.
Step Functions can control certain AWS services directly from Amazon States Language (ASL). To learn more, see Integrating other services and Passing parameters to a service API in Step Functions.
How the Optimized AWS Glue integration is different than the AWS GlueAWS SDK integration
The Run a Job (.sync) integration pattern is available.
The
JobName
field is extracted from the request and inserted into the response, which normally only containsJobRunID
.
Supported AWS Glue API:
Parameters in Step Functions are expressed in PascalCase
Even if the native service API is in camelCase, for example the API action startSyncExecution
, you specify parameters in PascalCase, such as: StateMachineArn
.
The following includes a Task
state that starts an AWS Glue job.
"Glue StartJobRun": { "Type": "Task", "Resource": "arn:aws:states:::glue:startJobRun.sync", "Parameters": { "JobName": "GlueJob-JTrRO5l98qMG" }, "Next": "ValidateOutput" },
For information about how to configure IAM permissions when using Step Functions with other AWS services, see How Step Functions generates IAM policies for integrated services.