Manage AWS Glue DataBrew Jobs with Step Functions

Step Functions can control certain AWS services directly from Amazon States Language (ASL). To learn more, see Working with other services and Pass parameters to a service API.

You can use the DataBrew integration to add data cleaning and data normalization steps into your analytics and machine learning workflows.

Supported DataBrew API:

• StartJobRun

The following includes a Task state that starts a request-response DataBrew job.

"DataBrew StartJobRun": {
            "Type": "Task",
            "Resource": "arn:aws:states:::databrew:startJobRun",
            "Parameters": {
               "Name": "sample-proj-job-1"
            },
            "Next": "NEXT_STATE"
          },
        

The following includes a Task state that starts a sync DataBrew job.

"DataBrew StartJobRun": {
           "Type": "Task",
           "Resource": "arn:aws:states:::databrew:startJobRun.sync",
           "Parameters": {
              "Name": "sample-proj-job-1"
           },
           "Next": "NEXT_STATE"
          },
        

For information about how to configure IAM permissions when using Step Functions with other AWS services, see IAM Policies for integrated services.