AWS services or capabilities described in AWS Documentation may vary by region/location. Click Getting Started with Amazon AWS to see specific differences applicable to the China (Beijing) Region.
New-GLUEDevEndpoint-PublicKey <String>-Argument <Hashtable>-EndpointName <String>-ExtraJarsS3Path <String>-ExtraPythonLibsS3Path <String>-GlueVersion <String>-NumberOfNode <Int32>-NumberOfWorker <Int32>-PublicKeyList <String[]>-RoleArn <String>-SecurityConfiguration <String>-SecurityGroupId <String[]>-SubnetId <String>-Tag <Hashtable>-WorkerType <WorkerType>-Select <String>-PassThru <SwitchParameter>-Force <SwitchParameter>
DevEndpoint
. Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
Aliases | Arguments |
DevEndpoint
. Required? | True |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
.jar
files in an S3 bucket that should be loaded in your DevEndpoint
. Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
DevEndpoint
. Multiple values must be complete paths separated by a comma.You can only use pure Python libraries with a DevEndpoint
. Libraries that rely on C extensions, such as the pandas Python data analysis library, are not yet supported. Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
Arguments
parameter in the CreateDevEndpoint
or UpdateDevEndpoint
APIs. If no arguments are provided, the version defaults to Python 2. Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
DevEndpoint
. Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
Aliases | NumberOfNodes |
workerType
that are allocated to the development endpoint.The maximum number of workers you can define are 299 for G.1X
, and 149 for G.2X
. Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
Aliases | NumberOfWorkers |
Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
DevEndpoint
for authentication. This attribute is provided for backward compatibility because the recommended attribute to use is public keys. Required? | False |
Position? | 1 |
Accept pipeline input? | True (ByValue, ByPropertyName) |
UpdateDevEndpoint
API with the public key content in the deletePublicKeys
attribute, and the list of new keys in the addPublicKeys
attribute. Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
DevEndpoint
. Required? | True |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
SecurityConfiguration
structure to be used with this DevEndpoint
. Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
DevEndpoint
. Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
Aliases | SecurityGroupIds |
Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
DevEndpoint
to use. Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
Aliases | Tags |
Standard
worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.G.1X
worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.G.2X
worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.G.2X
WorkerType
configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a 64 GB disk. Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
Aliases | AK |
Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
Used to specify the name and location of the ini-format credential file (shared with the AWS CLI and other AWS SDKs)
If this optional parameter is omitted this cmdlet will search the encrypted credential file used by the AWS SDK for .NET and AWS Toolkit for Visual Studio first. If the profile is not found then the cmdlet will search in the ini-format credential file at the default location: (user's home directory)\.aws\credentials. Note that the encrypted credential file is not supported on all platforms. It will be skipped when searching for profiles on Windows Nano Server, Mac, and Linux platforms.
If this parameter is specified then this cmdlet will only search the ini-format credential file at the location given.
As the current folder can vary in a shell or during script execution it is advised that you use specify a fully qualified path instead of a relative path.
Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
Aliases | AWSProfilesLocation, ProfilesLocation |
Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
Aliases | AWSProfileName, StoredCredentials |
Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
Aliases | SecretAccessKey, SK |
Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
Aliases | ST |
Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
Aliases | RegionToCall |
The endpoint to make the call against.
Note: This parameter is primarily for internal AWS use and is not required/should not be specified for normal usage. The cmdlets normally determine which endpoint to call based on the region specified to the -Region parameter or set as default in the shell (via Set-DefaultAWSRegion). Only specify this parameter if you must direct the call to a specific custom endpoint.
Required? | False |
Position? | Named |
Accept pipeline input? | True (ByPropertyName) |
AWS Tools for PowerShell: 2.x.y.z