Interface IPySparkFlexEtlJobProps
(experimental) Properties for PySparkFlexEtlJob.
Inherited Members
Namespace: Amazon.CDK.AWS.Glue.Alpha
Assembly: Amazon.CDK.AWS.Glue.Alpha.dll
Syntax (csharp)
public interface IPySparkFlexEtlJobProps : ISparkJobProps, IJobProps
Syntax (vb)
Public Interface IPySparkFlexEtlJobProps Inherits ISparkJobProps, IJobProps
Remarks
Stability: Experimental
ExampleMetadata: infused
Examples
using Amazon.CDK;
using Amazon.CDK.AWS.IAM;
Stack stack;
IRole role;
Code script;
new PySparkFlexEtlJob(stack, "ImportedJob", new PySparkFlexEtlJobProps { Role = role, Script = script });
Synopsis
Properties
| ExtraFiles | (experimental) Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it. |
| ExtraJars | (experimental) Extra Jars S3 URL (optional) S3 URL where additional jar dependencies are located. |
| ExtraJarsFirst | (experimental) Setting this value to true prioritizes the customer's extra JAR files in the classpath. |
| ExtraPythonFiles | (experimental) Extra Python Files S3 URL (optional) S3 URL where additional python dependencies are located. |
| NotifyDelayAfter | (experimental) Specifies configuration properties of a notification (optional). |
Properties
ExtraFiles
(experimental) Additional files, such as configuration files that AWS Glue copies to the working directory of your script before executing it.
Code[]? ExtraFiles { get; }
Property Value
Code[]
Remarks
Default: - no extra files specified.
Stability: Experimental
See: https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html
ExtraJars
(experimental) Extra Jars S3 URL (optional) S3 URL where additional jar dependencies are located.
Code[]? ExtraJars { get; }
Property Value
Code[]
Remarks
Default: - no extra jar files
Stability: Experimental
ExtraJarsFirst
(experimental) Setting this value to true prioritizes the customer's extra JAR files in the classpath.
bool? ExtraJarsFirst { get; }
Property Value
bool?
Remarks
Default: false - priority is not given to user-provided jars
Stability: Experimental
See: --user-jars-first in https://docs.aws.amazon.com/glue/latest/dg/aws-glue-programming-etl-glue-arguments.html
ExtraPythonFiles
(experimental) Extra Python Files S3 URL (optional) S3 URL where additional python dependencies are located.
Code[]? ExtraPythonFiles { get; }
Property Value
Code[]
Remarks
Default: - no extra files
Stability: Experimental
NotifyDelayAfter
(experimental) Specifies configuration properties of a notification (optional).
Duration? NotifyDelayAfter { get; }
Property Value
Remarks
After a job run starts, the number of minutes to wait before sending a job run delay notification.
Default: - undefined
Stability: Experimental