You are viewing documentation for version 2 of the AWS SDK for Ruby. Version 3 documentation can be found here.

Class: Aws::Glue::Types::DevEndpoint

Inherits:
Struct
  • Object
show all
Defined in:
(unknown)

Overview

A development endpoint where a developer can remotely debug extract, transform, and load (ETL) scripts.

Returned by:

Instance Attribute Summary collapse

Instance Attribute Details

#argumentsHash<String,String>

A map of arguments used to configure the DevEndpoint.

Currently, only "--enable-glue-datacatalog": "" is supported as a valid argument.

Returns:

  • (Hash<String,String>)

    A map of arguments used to configure the DevEndpoint.

#availability_zoneString

The AWS Availability Zone where this DevEndpoint is located.

Returns:

  • (String)

    The AWS Availability Zone where this DevEndpoint is located.

#created_timestampTime

The point in time at which this DevEndpoint was created.

Returns:

  • (Time)

    The point in time at which this DevEndpoint was created.

#endpoint_nameString

The name of the DevEndpoint.

Returns:

  • (String)

    The name of the DevEndpoint.

#extra_jars_s3_pathString

The path to one or more Java .jar files in an S3 bucket that should be loaded in your DevEndpoint.

You can only use pure Java/Scala libraries with a DevEndpoint.

Returns:

  • (String)

    The path to one or more Java .jar files in an S3 bucket that should be loaded in your DevEndpoint.

#extra_python_libs_s3_pathString

The paths to one or more Python libraries in an Amazon S3 bucket that should be loaded in your DevEndpoint. Multiple values must be complete paths separated by a comma.

You can only use pure Python libraries with a DevEndpoint. Libraries that rely on C extensions, such as the pandas Python data analysis library, are not currently supported.

Returns:

  • (String)

    The paths to one or more Python libraries in an Amazon S3 bucket that should be loaded in your DevEndpoint.

#failure_reasonString

The reason for a current failure in this DevEndpoint.

Returns:

  • (String)

    The reason for a current failure in this DevEndpoint.

#last_modified_timestampTime

The point in time at which this DevEndpoint was last modified.

Returns:

  • (Time)

    The point in time at which this DevEndpoint was last modified.

#last_update_statusString

The status of the last update.

Returns:

  • (String)

    The status of the last update.

#number_of_nodesInteger

The number of AWS Glue Data Processing Units (DPUs) allocated to this DevEndpoint.

Returns:

  • (Integer)

    The number of AWS Glue Data Processing Units (DPUs) allocated to this DevEndpoint.

#number_of_workersInteger

The number of workers of a defined workerType that are allocated to the development endpoint.

The maximum number of workers you can define are 299 for G.1X, and 149 for G.2X.

Returns:

  • (Integer)

    The number of workers of a defined workerType that are allocated to the development endpoint.

#private_addressString

A private IP address to access the DevEndpoint within a VPC if the DevEndpoint is created within one. The PrivateAddress field is present only when you create the DevEndpoint within your VPC.

Returns:

  • (String)

    A private IP address to access the DevEndpoint within a VPC if the DevEndpoint is created within one.

#public_addressString

The public IP address used by this DevEndpoint. The PublicAddress field is present only when you create a non-virtual private cloud (VPC) DevEndpoint.

Returns:

  • (String)

    The public IP address used by this DevEndpoint.

#public_keyString

The public key to be used by this DevEndpoint for authentication. This attribute is provided for backward compatibility because the recommended attribute to use is public keys.

Returns:

  • (String)

    The public key to be used by this DevEndpoint for authentication.

#public_keysArray<String>

A list of public keys to be used by the DevEndpoints for authentication. Using this attribute is preferred over a single public key because the public keys allow you to have a different private key per client.

If you previously created an endpoint with a public key, you must remove that key to be able to set a list of public keys. Call the UpdateDevEndpoint API operation with the public key content in the deletePublicKeys attribute, and the list of new keys in the addPublicKeys attribute.

Returns:

  • (Array<String>)

    A list of public keys to be used by the DevEndpoints for authentication.

#role_arnString

The Amazon Resource Name (ARN) of the IAM role used in this DevEndpoint.

Returns:

  • (String)

    The Amazon Resource Name (ARN) of the IAM role used in this DevEndpoint.

#security_configurationString

The name of the SecurityConfiguration structure to be used with this DevEndpoint.

Returns:

  • (String)

    The name of the SecurityConfiguration structure to be used with this DevEndpoint.

#security_group_idsArray<String>

A list of security group identifiers used in this DevEndpoint.

Returns:

  • (Array<String>)

    A list of security group identifiers used in this DevEndpoint.

#statusString

The current status of this DevEndpoint.

Returns:

  • (String)

    The current status of this DevEndpoint.

#subnet_idString

The subnet ID for this DevEndpoint.

Returns:

  • (String)

    The subnet ID for this DevEndpoint.

#vpc_idString

The ID of the virtual private cloud (VPC) used by this DevEndpoint.

Returns:

  • (String)

    The ID of the virtual private cloud (VPC) used by this DevEndpoint.

#worker_typeString

The type of predefined worker that is allocated to the development endpoint. Accepts a value of Standard, G.1X, or G.2X.

  • For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2 executors per worker.

  • For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.

  • For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.

Known issue: when a development endpoint is created with the G.2X WorkerType configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a 64 GB disk.

Possible values:

  • Standard
  • G.1X
  • G.2X

Returns:

  • (String)

    The type of predefined worker that is allocated to the development endpoint.

#yarn_endpoint_addressString

The YARN endpoint address used by this DevEndpoint.

Returns:

  • (String)

    The YARN endpoint address used by this DevEndpoint.

#zeppelin_remote_spark_interpreter_portInteger

The Apache Zeppelin port for the remote Apache Spark interpreter.

Returns:

  • (Integer)

    The Apache Zeppelin port for the remote Apache Spark interpreter.