SparkUIProps

class aws_cdk.aws_glue_alpha.SparkUIProps(*, enabled, bucket=None, prefix=None)

Bases: object

(experimental) Properties for enabling Spark UI monitoring feature for Spark-based Glue jobs.

Parameters:

enabled (bool) – (experimental) Enable Spark UI.
bucket (Optional[IBucket]) – (experimental) The bucket where the Glue job stores the logs. Default: - a new bucket will be created.
prefix (Optional[str]) – (experimental) The path inside the bucket (objects prefix) where the Glue job stores the logs. Use format 'foo/bar/' Default: - the logs will be written at the root of the bucket

See:

https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

Stability:

experimental

ExampleMetadata:

infused

Example:

glue.Job(self, "EnableSparkUI",
    job_name="EtlJobWithSparkUIPrefix",
    spark_uI=glue.SparkUIProps(
        enabled=True
    ),
    executable=glue.JobExecutable.python_etl(
        glue_version=glue.GlueVersion.V3_0,
        python_version=glue.PythonVersion.THREE,
        script=glue.Code.from_asset(path.join(__dirname, "job-script", "hello_world.py"))
    )
)

Attributes

bucket

(experimental) The bucket where the Glue job stores the logs.

Default:

a new bucket will be created.

Stability:

experimental

enabled

(experimental) Enable Spark UI.

Stability:: experimental

prefix

(experimental) The path inside the bucket (objects prefix) where the Glue job stores the logs.

Use format 'foo/bar/'

Default:

the logs will be written at the root of the bucket

Stability:

experimental