Interface ICfnDevEndpointProps
Properties for defining a CfnDevEndpoint
.
Namespace: Amazon.CDK.AWS.Glue
Assembly: Amazon.CDK.Lib.dll
Syntax (csharp)
public interface ICfnDevEndpointProps
Syntax (vb)
Public Interface ICfnDevEndpointProps
Remarks
See: http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-resource-glue-devendpoint.html
ExampleMetadata: fixture=_generated
Examples
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
using Amazon.CDK.AWS.Glue;
var arguments_;
var tags;
var cfnDevEndpointProps = new CfnDevEndpointProps {
RoleArn = "roleArn",
// the properties below are optional
Arguments = arguments_,
EndpointName = "endpointName",
ExtraJarsS3Path = "extraJarsS3Path",
ExtraPythonLibsS3Path = "extraPythonLibsS3Path",
GlueVersion = "glueVersion",
NumberOfNodes = 123,
NumberOfWorkers = 123,
PublicKey = "publicKey",
PublicKeys = new [] { "publicKeys" },
SecurityConfiguration = "securityConfiguration",
SecurityGroupIds = new [] { "securityGroupIds" },
SubnetId = "subnetId",
Tags = tags,
WorkerType = "workerType"
};
Synopsis
Properties
Arguments | A map of arguments used to configure the |
EndpointName | The name of the |
ExtraJarsS3Path | The path to one or more Java |
ExtraPythonLibsS3Path | The paths to one or more Python libraries in an Amazon S3 bucket that should be loaded in your |
GlueVersion | The AWS Glue version determines the versions of Apache Spark and Python that AWS Glue supports. |
NumberOfNodes | The number of AWS Glue Data Processing Units (DPUs) allocated to this |
NumberOfWorkers | The number of workers of a defined |
PublicKey | The public key to be used by this |
PublicKeys | A list of public keys to be used by the |
RoleArn | The Amazon Resource Name (ARN) of the IAM role used in this |
SecurityConfiguration | The name of the |
SecurityGroupIds | A list of security group identifiers used in this |
SubnetId | The subnet ID for this |
Tags | The tags to use with this DevEndpoint. |
WorkerType | The type of predefined worker that is allocated to the development endpoint. |
Properties
Arguments
A map of arguments used to configure the DevEndpoint
.
virtual object Arguments { get; }
Property Value
System.Object
Remarks
Valid arguments are:
You can specify a version of Python support for development endpoints by using the Arguments
parameter in the CreateDevEndpoint
or UpdateDevEndpoint
APIs. If no arguments are provided, the version defaults to Python 2.
EndpointName
The name of the DevEndpoint
.
virtual string EndpointName { get; }
Property Value
System.String
Remarks
ExtraJarsS3Path
The path to one or more Java .jar
files in an S3 bucket that should be loaded in your DevEndpoint
.
virtual string ExtraJarsS3Path { get; }
Property Value
System.String
Remarks
You can only use pure Java/Scala libraries with a DevEndpoint
.
ExtraPythonLibsS3Path
The paths to one or more Python libraries in an Amazon S3 bucket that should be loaded in your DevEndpoint
.
virtual string ExtraPythonLibsS3Path { get; }
Property Value
System.String
Remarks
Multiple values must be complete paths separated by a comma.
You can only use pure Python libraries with a DevEndpoint
. Libraries that rely on C extensions, such as the pandas Python data analysis library, are not currently supported.
GlueVersion
The AWS Glue version determines the versions of Apache Spark and Python that AWS Glue supports.
virtual string GlueVersion { get; }
Property Value
System.String
Remarks
The Python version indicates the version supported for running your ETL scripts on development endpoints.
For more information about the available AWS Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.
Development endpoints that are created without specifying a Glue version default to Glue 0.9.
You can specify a version of Python support for development endpoints by using the Arguments
parameter in the CreateDevEndpoint
or UpdateDevEndpoint
APIs. If no arguments are provided, the version defaults to Python 2.
NumberOfNodes
The number of AWS Glue Data Processing Units (DPUs) allocated to this DevEndpoint
.
virtual Nullable<double> NumberOfNodes { get; }
Property Value
System.Nullable<System.Double>
Remarks
NumberOfWorkers
The number of workers of a defined workerType
that are allocated to the development endpoint.
virtual Nullable<double> NumberOfWorkers { get; }
Property Value
System.Nullable<System.Double>
Remarks
The maximum number of workers you can define are 299 for G.1X
, and 149 for G.2X
.
PublicKey
The public key to be used by this DevEndpoint
for authentication.
virtual string PublicKey { get; }
Property Value
System.String
Remarks
This attribute is provided for backward compatibility because the recommended attribute to use is public keys.
PublicKeys
A list of public keys to be used by the DevEndpoints
for authentication.
virtual string[] PublicKeys { get; }
Property Value
System.String[]
Remarks
Using this attribute is preferred over a single public key because the public keys allow you to have a different private key per client.
If you previously created an endpoint with a public key, you must remove that key to be able to set a list of public keys. Call the UpdateDevEndpoint
API operation with the public key content in the deletePublicKeys
attribute, and the list of new keys in the addPublicKeys
attribute.
RoleArn
The Amazon Resource Name (ARN) of the IAM role used in this DevEndpoint
.
string RoleArn { get; }
Property Value
System.String
Remarks
SecurityConfiguration
The name of the SecurityConfiguration
structure to be used with this DevEndpoint
.
virtual string SecurityConfiguration { get; }
Property Value
System.String
Remarks
SecurityGroupIds
A list of security group identifiers used in this DevEndpoint
.
virtual string[] SecurityGroupIds { get; }
Property Value
System.String[]
Remarks
SubnetId
The subnet ID for this DevEndpoint
.
virtual string SubnetId { get; }
Property Value
System.String
Remarks
Tags
The tags to use with this DevEndpoint.
virtual object Tags { get; }
Property Value
System.Object
Remarks
WorkerType
The type of predefined worker that is allocated to the development endpoint.
virtual string WorkerType { get; }
Property Value
System.String
Remarks
Accepts a value of Standard, G.1X, or G.2X.
Known issue: when a development endpoint is created with the G.2X
WorkerType
configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a 64 GB disk.