interface JobExecutableConfig
Language | Type name |
---|---|
.NET | Amazon.CDK.AWS.Glue.Alpha.JobExecutableConfig |
Go | github.com/aws/aws-cdk-go/awscdkgluealpha/v2#JobExecutableConfig |
Java | software.amazon.awscdk.services.glue.alpha.JobExecutableConfig |
Python | aws_cdk.aws_glue_alpha.JobExecutableConfig |
TypeScript (source) | @aws-cdk/aws-glue-alpha ยป JobExecutableConfig |
Obtainable from
Job
.bind()
Result of binding a JobExecutable
into a Job
.
Example
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import * as glue_alpha from '@aws-cdk/aws-glue-alpha';
declare const code: glue_alpha.Code;
declare const glueVersion: glue_alpha.GlueVersion;
declare const jobType: glue_alpha.JobType;
declare const runtime: glue_alpha.Runtime;
const jobExecutableConfig: glue_alpha.JobExecutableConfig = {
glueVersion: glueVersion,
language: glue_alpha.JobLanguage.SCALA,
script: code,
type: jobType,
// the properties below are optional
className: 'className',
extraFiles: [code],
extraJars: [code],
extraJarsFirst: false,
extraPythonFiles: [code],
pythonVersion: glue_alpha.PythonVersion.TWO,
runtime: runtime,
s3PythonModules: [code],
};
Properties
Name | Type | Description |
---|---|---|
glue | Glue | Glue version. |
language | Job | The language of the job (Scala or Python). |
script | Code | The script that is executed by a job. |
type | Job | Specify the type of the job whether it's an Apache Spark ETL or streaming one or if it's a Python shell job. |
class | string | The Scala class that serves as the entry point for the job. |
extra | Code [] | Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it. |
extra | Code [] | Additional Java .jar files that AWS Glue adds to the Java classpath before executing your script. Equivalent to a job parameter --extra-jars . |
extra | boolean | Setting this value to true prioritizes the customer's extra JAR files in the classpath. |
extra | Code [] | Additional Python files that AWS Glue adds to the Python path before executing your script. |
python | Python | The Python version to use. |
runtime? | Runtime | The Runtime to use. |
s3 | Code [] | Additional Python modules that AWS Glue adds to the Python path before executing your script. |
glueVersion
Type:
Glue
Glue version.
See also: https://docs.aws.amazon.com/glue/latest/dg/release-notes.html
language
Type:
Job
The language of the job (Scala or Python).
Equivalent to a job parameter --job-language
.
See also: https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html
script
Type:
Code
The script that is executed by a job.
type
Type:
Job
Specify the type of the job whether it's an Apache Spark ETL or streaming one or if it's a Python shell job.
className?
Type:
string
(optional, default: no scala className specified)
The Scala class that serves as the entry point for the job.
This applies only if your the job langauage is Scala.
Equivalent to a job parameter --class
.
See also: https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html
extraFiles?
Type:
Code
[]
(optional, default: no extra files specified.)
Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it.
Equivalent to a job parameter --extra-files
.
See also: https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html
extraJars?
Type:
Code
[]
(optional, default: no extra jars specified.)
Additional Java .jar files that AWS Glue adds to the Java classpath before executing your script. Equivalent to a job parameter --extra-jars
.
See also: https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html
extraJarsFirst?
Type:
boolean
(optional, default: extra jars are not prioritized.)
Setting this value to true prioritizes the customer's extra JAR files in the classpath.
Equivalent to a job parameter --user-jars-first
.
See also: https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html
extraPythonFiles?
Type:
Code
[]
(optional, default: no extra python files specified.)
Additional Python files that AWS Glue adds to the Python path before executing your script.
Equivalent to a job parameter --extra-py-files
.
See also: https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html
pythonVersion?
Type:
Python
(optional, default: no python version specified)
The Python version to use.
runtime?
Type:
Runtime
(optional, default: no runtime specified)
The Runtime to use.
s3PythonModules?
Type:
Code
[]
(optional, default: no extra python files specified.)
Additional Python modules that AWS Glue adds to the Python path before executing your script.
Equivalent to a job parameter --s3-py-modules
.
See also: https://docs.aws.amazon.com/glue/latest/dg/author-job-ray-job-parameters.html