SparkConnectorTarget - AWS Glue

SparkConnectorTarget

Specifies a target that uses an Apache Spark connector.

Contents

ConnectionName

The name of a connection for an Apache Spark connector.

Type: String

Pattern: ([\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF]|[^\S\r\n"'])*

Required: Yes

ConnectionType

The type of connection, such as marketplace.spark or custom.spark, designating a connection to an Apache Spark data store.

Type: String

Pattern: ([\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF]|[^\S\r\n"'])*

Required: Yes

ConnectorName

The name of an Apache Spark connector.

Type: String

Pattern: ([\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF]|[^\S\r\n"'])*

Required: Yes

Inputs

The nodes that are inputs to the data target.

Type: Array of strings

Array Members: Fixed number of 1 item.

Pattern: [A-Za-z0-9_-]*

Required: Yes

Name

The name of the data target.

Type: String

Pattern: ([\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF]|[^\r\n])*

Required: Yes

AdditionalOptions

Additional connection options for the connector.

Type: String to string map

Key Pattern: ([\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF]|[^\S\r\n"'])*

Value Pattern: ([\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF]|[^\S\r\n"'])*

Required: No

OutputSchemas

Specifies the data schema for the custom spark target.

Type: Array of GlueSchema objects

Required: No

See Also

For more information about using this API in one of the language-specific AWS SDKs, see the following: