S3DirectTarget - AWS Glue

S3DirectTarget

Specifies a data target that writes to Amazon S3.

Contents

Format

Specifies the data output format for the target.

Type: String

Valid Values: json | csv | avro | orc | parquet | hudi | delta

Required: Yes

Inputs

The nodes that are inputs to the data target.

Type: Array of strings

Array Members: Fixed number of 1 item.

Pattern: [A-Za-z0-9_-]*

Required: Yes

Name

The name of the data target.

Type: String

Pattern: ([\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF]|[^\r\n])*

Required: Yes

Path

A single Amazon S3 path to write to.

Type: String

Pattern: ([\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF]|[^\S\r\n"'])*

Required: Yes

Compression

Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

Type: String

Pattern: ([\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF]|[^\S\r\n"'])*

Required: No

PartitionKeys

Specifies native partitioning using a sequence of keys.

Type: Array of arrays of strings

Pattern: ([\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF]|[^\S\r\n"'])*

Required: No

SchemaChangePolicy

A policy that specifies update behavior for the crawler.

Type: DirectSchemaChangePolicy object

Required: No

See Also

For more information about using this API in one of the language-specific AWS SDKs, see the following: