software.amazon.awscdk.services.glue

Interface PythonSparkJobExecutableProps

All Known Implementing Classes:

PythonSparkJobExecutableProps.Jsii$Proxy

@Generated(value="jsii-pacmak/1.58.0 (build f8ba112)",
           date="2022-05-13T01:13:35.185Z")
public interface PythonSparkJobExecutableProps

(experimental) Props for creating a Python Spark (ETL or Streaming) job executable.

Example:

 Job.Builder.create(this, "PythonSparkStreamingJob")
         .executable(JobExecutable.pythonStreaming(PythonSparkJobExecutableProps.builder()
                 .glueVersion(GlueVersion.V2_0)
                 .pythonVersion(PythonVersion.THREE)
                 .script(Code.fromAsset(join(__dirname, "job-script/hello_world.py")))
                 .build()))
         .description("an example Python Streaming job")
         .build();
 

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	PythonSparkJobExecutableProps.Builder A builder for PythonSparkJobExecutableProps
static class	PythonSparkJobExecutableProps.Jsii$Proxy An implementation for PythonSparkJobExecutableProps

Method Summary

Modifier and Type	Method and Description
static PythonSparkJobExecutableProps.Builder	builder()
default java.util.List<Code>	getExtraFiles() (experimental) Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it.
default java.util.List<Code>	getExtraJars() (experimental) Additional Java .jar files that AWS Glue adds to the Java classpath before executing your script.
default java.lang.Boolean	getExtraJarsFirst() (experimental) Setting this value to true prioritizes the customer's extra JAR files in the classpath.
default java.util.List<Code>	getExtraPythonFiles() (experimental) Additional Python files that AWS Glue adds to the Python path before executing your script.
GlueVersion	getGlueVersion() (experimental) Glue version.
PythonVersion	getPythonVersion() (experimental) The Python version to use.
Code	getScript() (experimental) The script that executes a job.

Method Detail

getGlueVersion

GlueVersion getGlueVersion()

(experimental) Glue version.

See Also:

https://docs.aws.amazon.com/glue/latest/dg/release-notes.html

getPythonVersion

PythonVersion getPythonVersion()

(experimental) The Python version to use.

getScript

Code getScript()

(experimental) The script that executes a job.

getExtraFiles

default java.util.List<Code> getExtraFiles()

(experimental) Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it.

Only individual files are supported, directories are not supported.

Default: [] - no extra files are copied to the working directory

See Also:

in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

getExtraJars

default java.util.List<Code> getExtraJars()

(experimental) Additional Java .jar files that AWS Glue adds to the Java classpath before executing your script. Only individual files are supported, directories are not supported.

Default: [] - no extra jars are added to the classpath

See Also:

in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

getExtraJarsFirst

default java.lang.Boolean getExtraJarsFirst()

(experimental) Setting this value to true prioritizes the customer's extra JAR files in the classpath.

Default: false - priority is not given to user-provided jars

See Also:

in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

getExtraPythonFiles

default java.util.List<Code> getExtraPythonFiles()

(experimental) Additional Python files that AWS Glue adds to the Python path before executing your script.

Only individual files are supported, directories are not supported.

Default: - no extra python files and argument is not set

See Also:

in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

builder

static PythonSparkJobExecutableProps.Builder builder()

Returns:

a PythonSparkJobExecutableProps.Builder of PythonSparkJobExecutableProps