PythonRayExecutableProps

class aws_cdk.aws_glue_alpha.PythonRayExecutableProps(*, glue_version, python_version, script, extra_files=None, runtime=None, s3_python_modules=None)

Bases: object

(experimental) Props for creating a Python Ray job executable.

Parameters:

glue_version (GlueVersion) – (experimental) Glue version.
python_version (PythonVersion) – (experimental) The Python version to use.
script (Code) – (experimental) The script that executes a job.
extra_files (Optional[Sequence[Code]]) – (experimental) Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it. Only individual files are supported, directories are not supported. Equivalent to a job parameter --extra-files. Default: [] - no extra files are copied to the working directory
runtime (Optional[Runtime]) – (experimental) Runtime. It is required for Ray jobs.
s3_python_modules (Optional[Sequence[Code]]) – (experimental) Additional Python modules that AWS Glue adds to the Python path before executing your script. Equivalent to a job parameter --s3-py-modules. Default: - no extra python files and argument is not set

Stability:

experimental

ExampleMetadata:

infused

Example:

glue.Job(self, "RayJob",
    executable=glue.JobExecutable.python_ray(
        glue_version=glue.GlueVersion.V4_0,
        python_version=glue.PythonVersion.THREE_NINE,
        runtime=glue.Runtime.RAY_TWO_FOUR,
        script=glue.Code.from_asset(path.join(__dirname, "job-script", "hello_world.py"))
    ),
    worker_type=glue.WorkerType.Z_2X,
    worker_count=2,
    description="an example Ray job"
)

Attributes

extra_files

(experimental) Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it.

Only individual files are supported, directories are not supported. Equivalent to a job parameter --extra-files.

Default:: [] - no extra files are copied to the working directory
See:: https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html
Stability:: experimental

glue_version

(experimental) Glue version.

See:: https://docs.aws.amazon.com/glue/latest/dg/release-notes.html
Stability:: experimental

python_version

(experimental) The Python version to use.

Stability:: experimental

runtime

(experimental) Runtime.

It is required for Ray jobs.

Stability:: experimental

s3_python_modules

(experimental) Additional Python modules that AWS Glue adds to the Python path before executing your script.

Equivalent to a job parameter --s3-py-modules.

Default:

no extra python files and argument is not set

See:

https://docs.aws.amazon.com/glue/latest/dg/author-job-ray-job-parameters.html

Stability:

experimental

script

(experimental) The script that executes a job.

Stability:: experimental