interface SparkUIProps
Language | Type name |
---|---|
.NET | Amazon.CDK.AWS.Glue.Alpha.SparkUIProps |
Go | github.com/aws/aws-cdk-go/awscdkgluealpha/v2#SparkUIProps |
Java | software.amazon.awscdk.services.glue.alpha.SparkUIProps |
Python | aws_cdk.aws_glue_alpha.SparkUIProps |
TypeScript (source) | @aws-cdk/aws-glue-alpha » SparkUIProps |
Properties for enabling Spark UI monitoring feature for Spark-based Glue jobs.
See also: https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html
Example
new glue.Job(this, 'EnableSparkUI', {
jobName: 'EtlJobWithSparkUIPrefix',
sparkUI: {
enabled: true,
},
executable: glue.JobExecutable.pythonEtl({
glueVersion: glue.GlueVersion.V3_0,
pythonVersion: glue.PythonVersion.THREE,
script: glue.Code.fromAsset(path.join(__dirname, 'job-script', 'hello_world.py')),
}),
});
Properties
Name | Type | Description |
---|---|---|
enabled | boolean | Enable Spark UI. |
bucket? | IBucket | The bucket where the Glue job stores the logs. |
prefix? | string | The path inside the bucket (objects prefix) where the Glue job stores the logs. |
enabled
Type:
boolean
Enable Spark UI.
bucket?
Type:
IBucket
(optional, default: a new bucket will be created.)
The bucket where the Glue job stores the logs.
prefix?
Type:
string
(optional, default: the logs will be written at the root of the bucket)
The path inside the bucket (objects prefix) where the Glue job stores the logs.
Use format 'foo/bar/'