SparkUIProps

class aws_cdk.aws_glue.SparkUIProps(*, enabled, bucket=None, prefix=None)

Bases: object

(experimental) Properties for enabling Spark UI monitoring feature for Spark-based Glue jobs.

Parameters:
  • enabled (bool) – (experimental) Enable Spark UI.

  • bucket (Optional[IBucket]) – (experimental) The bucket where the Glue job stores the logs. Default: a new bucket will be created.

  • prefix (Optional[str]) – (experimental) The path inside the bucket (objects prefix) where the Glue job stores the logs. Default: ‘/’ - the logs will be written at the root of the bucket

See:

https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

Stability:

experimental

ExampleMetadata:

fixture=_generated

Example:

# The code below shows an example of how to instantiate this type.
# The values are placeholders you should change.
import aws_cdk.aws_glue as glue
import aws_cdk.aws_s3 as s3

# bucket: s3.Bucket

spark_uIProps = glue.SparkUIProps(
    enabled=False,

    # the properties below are optional
    bucket=bucket,
    prefix="prefix"
)

Attributes

bucket

(experimental) The bucket where the Glue job stores the logs.

Default:

a new bucket will be created.

Stability:

experimental

enabled

(experimental) Enable Spark UI.

Stability:

experimental

prefix

(experimental) The path inside the bucket (objects prefix) where the Glue job stores the logs.

Default:

‘/’ - the logs will be written at the root of the bucket

Stability:

experimental