SparkConnectorSource
Specifies a connector to an Apache Spark data source.
Contents
- ConnectionName
-
The name of the connection that is associated with the connector.
Type: String
Pattern:
([\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF]|[^\S\r\n"'])*Required: Yes
- ConnectionType
-
The type of connection, such as marketplace.spark or custom.spark, designating a connection to an Apache Spark data store.
Type: String
Pattern:
([\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF]|[^\S\r\n"'])*Required: Yes
- ConnectorName
-
The name of a connector that assists with accessing the data store in AWS Glue Studio.
Type: String
Pattern:
([\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF]|[^\S\r\n"'])*Required: Yes
- Name
-
The name of the data source.
Type: String
Pattern:
([\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF]|[^\r\n])*Required: Yes
- AdditionalOptions
-
Additional connection options for the connector.
Type: String to string map
Key Pattern:
([\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF]|[^\S\r\n"'])*Value Pattern:
([\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF]|[^\S\r\n"'])*Required: No
- OutputSchemas
-
Specifies data schema for the custom spark source.
Type: Array of GlueSchema objects
Required: No
See Also
For more information about using this API in one of the language-specific AWS SDKs, see the following:
