SnowflakeNodeData

Specifies configuration for Snowflake nodes in AWS Glue Studio.

Action

Specifies what action to take when writing to a table with preexisting data. Valid values: append, merge, truncate, drop.

Type: String

Required: No

AdditionalOptions

Specifies additional options passed to the Snowflake connector. If options are specified elsewhere in this node, this will take precedence.

Type: String to string map

Key Pattern: ([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*

Value Pattern: ([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*

Required: No

AutoPushdown

Specifies whether automatic query pushdown is enabled. If pushdown is enabled, then when a query is run on Spark, if part of the query can be "pushed down" to the Snowflake server, it is pushed down. This improves performance of some queries.

Type: Boolean

Required: No

Connection

Specifies a AWS Glue Data Catalog Connection to a Snowflake endpoint.

Type: Option object

Required: No

Database

Specifies a Snowflake database for your node to use.

Type: String

Required: No

IamRole

Not currently used.

Type: Option object

Required: No

MergeAction

Specifies a merge action. Valid values: simple, custom. If simple, merge behavior is defined by MergeWhenMatched and MergeWhenNotMatched. If custom, defined by MergeClause.

Type: String

Pattern: [A-Za-z0-9_-]*

Required: No

MergeClause

A SQL statement that specifies a custom merge behavior.

Type: String

Required: No

MergeWhenMatched

Specifies how to resolve records that match preexisting data when merging. Valid values: update, delete.

Type: String

Pattern: [A-Za-z0-9_-]*

Required: No

MergeWhenNotMatched

Specifies how to process records that do not match preexisting data when merging. Valid values: insert, none.

Type: String

Pattern: [A-Za-z0-9_-]*

Required: No

PostAction

A SQL string run after the Snowflake connector performs its standard actions.

Type: String

Required: No

PreAction

A SQL string run before the Snowflake connector performs its standard actions.

Type: String

Required: No

SampleQuery

A SQL string used to retrieve data with the query sourcetype.

Type: String

Required: No

Schema

Specifies a Snowflake database schema for your node to use.

Type: String

Required: No

SelectedColumns

Specifies the columns combined to identify a record when detecting matches for merges and upserts. A list of structures with value, label and description keys. Each structure describes a column.

Type: Array of Option objects

Required: No

SourceType

Specifies how retrieved data is specified. Valid values: "table", "query".

Type: String

Pattern: [A-Za-z0-9_-]*

Required: No

StagingTable

The name of a staging table used when performing merge or upsert append actions. Data is written to this table, then moved to table by a generated postaction.

Type: String

Required: No

Table

Specifies a Snowflake table for your node to use.

Type: String

Required: No

TableSchema

Manually defines the target schema for the node. A list of structures with value , label and description keys. Each structure defines a column.

Type: Array of Option objects

Required: No

TempDir

Not currently used.

Type: String

Pattern: ([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*

Required: No

Upsert

Used when Action is append. Specifies the resolution behavior when a row already exists. If true, preexisting rows will be updated. If false, those rows will be inserted.

Type: Boolean

Required: No

SnowflakeNodeData

Contents

See Also