Manage AWS Glue Jobs with Step Functions

Step Functions can control certain AWS services directly from the Amazon States Language. For more information, see the following:

• Service Integrations

• Pass Parameters to a Service API

Supported AWS Glue APIs:

• StartJobRun

• Supported Parameters:

  • JobName

  • JobRunId

  • Arguments

  • AllocatedCapacity

  • Timeout

  • SecurityConfiguration

  • NotificationProperty

The following includes a Task state that starts an AWS Glue job.

"Glue StartJobRun": {
      "Type": "Task",
      "Resource": "arn:aws:states:::glue:startJobRun.sync",
      "Parameters": {
        "JobName": "GlueJob-JTrRO5l98qMG"
      },
      "Next": "ValidateOutput"
    },

For information on how to configure IAM when using Step Functions with other AWS services, see IAM Policies for Integrated Services.