interface PythonRayExecutableProps
Language | Type name |
---|---|
.NET | Amazon.CDK.AWS.Glue.Alpha.PythonRayExecutableProps |
Go | github.com/aws/aws-cdk-go/awscdkgluealpha/v2#PythonRayExecutableProps |
Java | software.amazon.awscdk.services.glue.alpha.PythonRayExecutableProps |
Python | aws_cdk.aws_glue_alpha.PythonRayExecutableProps |
TypeScript (source) | @aws-cdk/aws-glue-alpha ยป PythonRayExecutableProps |
Props for creating a Python Ray job executable.
Example
new glue.Job(this, 'RayJob', {
executable: glue.JobExecutable.pythonRay({
glueVersion: glue.GlueVersion.V4_0,
pythonVersion: glue.PythonVersion.THREE_NINE,
runtime: glue.Runtime.RAY_TWO_FOUR,
script: glue.Code.fromAsset(path.join(__dirname, 'job-script', 'hello_world.py')),
}),
workerType: glue.WorkerType.Z_2X,
workerCount: 2,
description: 'an example Ray job'
});
Properties
Name | Type | Description |
---|---|---|
glue | Glue | Glue version. |
python | Python | The Python version to use. |
script | Code | The script that executes a job. |
extra | Code [] | Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it. |
runtime? | Runtime | Runtime. |
s3 | Code [] | Additional Python modules that AWS Glue adds to the Python path before executing your script. |
glueVersion
Type:
Glue
Glue version.
See also: https://docs.aws.amazon.com/glue/latest/dg/release-notes.html
pythonVersion
Type:
Python
The Python version to use.
script
Type:
Code
The script that executes a job.
extraFiles?
Type:
Code
[]
(optional, default: [] - no extra files are copied to the working directory)
Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it.
Only individual files are supported, directories are not supported.
Equivalent to a job parameter --extra-files
.
See also: https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html
runtime?
Type:
Runtime
(optional)
Runtime.
It is required for Ray jobs.
s3PythonModules?
Type:
Code
[]
(optional, default: no extra python files and argument is not set)
Additional Python modules that AWS Glue adds to the Python path before executing your script.
Equivalent to a job parameter --s3-py-modules
.
See also: https://docs.aws.amazon.com/glue/latest/dg/author-job-ray-job-parameters.html