SparkUIProps

class aws_cdk.aws_glue_alpha.SparkUIProps(*, bucket=None, job_run_queuing_enabled=None, prefix=None)

Bases: object

(experimental) Properties for enabling Spark UI monitoring feature for Spark-based Glue jobs.

Parameters:

  • bucket (Optional[IBucket]) – (experimental) The bucket where the Glue job stores the logs. Default: a new bucket will be created.

  • job_run_queuing_enabled (Optional[bool]) – (experimental) Specifies whether job run queuing is enabled for the job runs for this job. A value of true means job run queuing is enabled for the job runs. If false or not populated, the job runs will not be considered for queueing. If this field does not match the value set in the job run, then the value from the job run field will be used. This property must be set to false for flex jobs. If this property is enabled, maxRetries must be set to zero. Default: - no job run queuing

  • prefix (Optional[str]) – (experimental) The path inside the bucket (objects prefix) where the Glue job stores the logs. Use format '/foo/bar' Default: - the logs will be written at the root of the bucket

See:

https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

Stability:

experimental

ExampleMetadata:

fixture=_generated

Example:

# The code below shows an example of how to instantiate this type.
# The values are placeholders you should change.
import aws_cdk.aws_glue_alpha as glue_alpha
from aws_cdk import aws_s3 as s3

# bucket: s3.Bucket

spark_uIProps = glue_alpha.SparkUIProps(
    bucket=bucket,
    job_run_queuing_enabled=False,
    prefix="prefix"
)

Attributes

bucket

(experimental) The bucket where the Glue job stores the logs.

Default:

a new bucket will be created.

Stability:

experimental

job_run_queuing_enabled

(experimental) Specifies whether job run queuing is enabled for the job runs for this job.

A value of true means job run queuing is enabled for the job runs. If false or not populated, the job runs will not be considered for queueing. If this field does not match the value set in the job run, then the value from the job run field will be used. This property must be set to false for flex jobs. If this property is enabled, maxRetries must be set to zero.

Default:

  • no job run queuing

Stability:

experimental

prefix

(experimental) The path inside the bucket (objects prefix) where the Glue job stores the logs.

Use format '/foo/bar'

Default:

  • the logs will be written at the root of the bucket

Stability:

experimental