software.amazon.awscdk.services.stepfunctions.tasks

Interface JobDriver

All Known Implementing Classes:

JobDriver.Jsii$Proxy

@Generated(value="jsii-pacmak/1.74.0 (build 6d08790)",
           date="2023-03-22T19:35:50.335Z")
public interface JobDriver

Specify the driver that the EMR Containers job runs on.

The job driver is used to provide an input for the job that will be run.

Example:

 EmrContainersStartJobRun.Builder.create(this, "EMR Containers Start Job Run")
         .virtualCluster(VirtualClusterInput.fromVirtualClusterId("de92jdei2910fwedz"))
         .releaseLabel(ReleaseLabel.EMR_6_2_0)
         .jobName("EMR-Containers-Job")
         .jobDriver(JobDriver.builder()
                 .sparkSubmitJobDriver(SparkSubmitJobDriver.builder()
                         .entryPoint(TaskInput.fromText("local:///usr/lib/spark/examples/src/main/python/pi.py"))
                         .build())
                 .build())
         .applicationConfig(List.of(ApplicationConfiguration.builder()
                 .classification(Classification.SPARK_DEFAULTS)
                 .properties(Map.of(
                         "spark.executor.instances", "1",
                         "spark.executor.memory", "512M"))
                 .build()))
         .build();
 

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	JobDriver.Builder A builder for JobDriver
static class	JobDriver.Jsii$Proxy An implementation for JobDriver

Method Summary

Modifier and Type	Method and Description
static JobDriver.Builder	builder()
SparkSubmitJobDriver	getSparkSubmitJobDriver() The job driver parameters specified for spark submit.

Method Detail

getSparkSubmitJobDriver

SparkSubmitJobDriver getSparkSubmitJobDriver()

The job driver parameters specified for spark submit.

See Also:

https://docs.aws.amazon.com/emr-on-eks/latest/APIReference/API_SparkSubmitJobDriver.html

builder

static JobDriver.Builder builder()

Returns:

a JobDriver.Builder of JobDriver