class WorkerType
Language | Type name |
---|---|
.NET | Amazon.CDK.AWS.Glue.Alpha.WorkerType |
Go | github.com/aws/aws-cdk-go/awscdkgluealpha/v2#WorkerType |
Java | software.amazon.awscdk.services.glue.alpha.WorkerType |
Python | aws_cdk.aws_glue_alpha.WorkerType |
TypeScript (source) | @aws-cdk/aws-glue-alpha ยป WorkerType |
The type of predefined worker that is allocated when a job runs.
If you need to use a WorkerType that doesn't exist as a static member, you
can instantiate a WorkerType
object, e.g: WorkerType.of('other type')
.
Example
declare const bucket: s3.Bucket;
new glue.Job(this, 'ScalaSparkEtlJob', {
executable: glue.JobExecutable.scalaEtl({
glueVersion: glue.GlueVersion.V4_0,
script: glue.Code.fromBucket(bucket, 'src/com/example/HelloWorld.scala'),
className: 'com.example.HelloWorld',
extraJars: [glue.Code.fromBucket(bucket, 'jars/HelloWorld.jar')],
}),
workerType: glue.WorkerType.G_8X,
description: 'an example Scala ETL job',
});
Properties
Name | Type | Description |
---|---|---|
name | string | The name of this WorkerType, as expected by Job resource. |
static G_025 | Worker | Each worker maps to 0.25 DPU (2 vCPU, 4 GB of memory, 64 GB disk), and provides 1 executor per worker. Suitable for low volume streaming jobs. |
static G_1 | Worker | Each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker. |
static G_2 | Worker | Each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker. |
static G_4 | Worker | Each worker maps to 4 DPU (16 vCPU, 64 GB of memory, 256 GB disk), and provides 1 executor per worker. |
static G_8 | Worker | Each worker maps to 8 DPU (32 vCPU, 128 GB of memory, 512 GB disk), and provides 1 executor per worker. |
static STANDARD | Worker | Each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker. |
static Z_2 | Worker | Each worker maps to 2 high-memory DPU [M-DPU] (8 vCPU, 64 GB of memory, 128 GB disk). |
name
Type:
string
The name of this WorkerType, as expected by Job resource.
static G_025X
Type:
Worker
Each worker maps to 0.25 DPU (2 vCPU, 4 GB of memory, 64 GB disk), and provides 1 executor per worker. Suitable for low volume streaming jobs.
static G_1X
Type:
Worker
Each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker.
Suitable for memory-intensive jobs.
static G_2X
Type:
Worker
Each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker.
Suitable for memory-intensive jobs.
static G_4X
Type:
Worker
Each worker maps to 4 DPU (16 vCPU, 64 GB of memory, 256 GB disk), and provides 1 executor per worker.
We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for AWS Glue version 3.0 or later jobs.
static G_8X
Type:
Worker
Each worker maps to 8 DPU (32 vCPU, 128 GB of memory, 512 GB disk), and provides 1 executor per worker.
We recommend this worker type for jobs whose workloads contain your most demanding transforms, aggregations, joins, and queries. This worker type is available only for AWS Glue version 3.0 or later jobs.
static STANDARD
Type:
Worker
Each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.
static Z_2X
Type:
Worker
Each worker maps to 2 high-memory DPU [M-DPU] (8 vCPU, 64 GB of memory, 128 GB disk).
Supported in Ray jobs.
Methods
Name | Description |
---|---|
static of(workerType) | Custom worker type. |
static of(workerType)
public static of(workerType: string): WorkerType
Parameters
- workerType
string
โ custom worker type.
Returns
Custom worker type.