Show / Hide Table of Contents

Interface IPySparkFlexEtlJobProps

(experimental) Properties for PySparkFlexEtlJob.

Inherited Members
ISparkJobProps.EnableMetrics
ISparkJobProps.EnableObservabilityMetrics
ISparkJobProps.SparkUI
IJobProps.Role
IJobProps.Script
IJobProps.Connections
IJobProps.ContinuousLogging
IJobProps.DefaultArguments
IJobProps.Description
IJobProps.EnableProfilingMetrics
IJobProps.GlueVersion
IJobProps.JobName
IJobProps.MaxConcurrentRuns
IJobProps.MaxRetries
IJobProps.NumberOfWorkers
IJobProps.SecurityConfiguration
IJobProps.Tags
IJobProps.Timeout
IJobProps.WorkerType
Namespace: Amazon.CDK.AWS.Glue.Alpha
Assembly: Amazon.CDK.AWS.Glue.Alpha.dll
Syntax (csharp)
public interface IPySparkFlexEtlJobProps : ISparkJobProps, IJobProps
Syntax (vb)
Public Interface IPySparkFlexEtlJobProps Inherits ISparkJobProps, IJobProps
Remarks

Stability: Experimental

ExampleMetadata: infused

Examples
using Amazon.CDK;
             using Amazon.CDK.AWS.IAM;
             Stack stack;
             IRole role;
             Code script;

             new PySparkFlexEtlJob(stack, "ImportedJob", new PySparkFlexEtlJobProps { Role = role, Script = script });

Synopsis

Properties

ExtraFiles

(experimental) Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it.

ExtraJars

(experimental) Extra Jars S3 URL (optional) S3 URL where additional jar dependencies are located.

ExtraJarsFirst

(experimental) Setting this value to true prioritizes the customer's extra JAR files in the classpath.

ExtraPythonFiles

(experimental) Extra Python Files S3 URL (optional) S3 URL where additional python dependencies are located.

NotifyDelayAfter

(experimental) Specifies configuration properties of a notification (optional).

Properties

ExtraFiles

(experimental) Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it.

Code[]? ExtraFiles { get; }
Property Value

Code[]

Remarks

Default: - no extra files specified.

Stability: Experimental

See: https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

ExtraJars

(experimental) Extra Jars S3 URL (optional) S3 URL where additional jar dependencies are located.

Code[]? ExtraJars { get; }
Property Value

Code[]

Remarks

Default: - no extra jar files

Stability: Experimental

ExtraJarsFirst

(experimental) Setting this value to true prioritizes the customer's extra JAR files in the classpath.

bool? ExtraJarsFirst { get; }
Property Value

bool?

Remarks

Default: false - priority is not given to user-provided jars

Stability: Experimental

See: --user-jars-first in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html

ExtraPythonFiles

(experimental) Extra Python Files S3 URL (optional) S3 URL where additional python dependencies are located.

Code[]? ExtraPythonFiles { get; }
Property Value

Code[]

Remarks

Default: - no extra files

Stability: Experimental

NotifyDelayAfter

(experimental) Specifies configuration properties of a notification (optional).

Duration? NotifyDelayAfter { get; }
Property Value

Duration

Remarks

After a job run starts, the number of minutes to wait before sending a job run delay notification.

Default: - undefined

Stability: Experimental

Back to top Generated by DocFX