S3HudiDirectTarget

PDF

Specifies a target that writes to a Hudi data source in Amazon S3.

Contents

AdditionalOptions

Specifies additional connection options for the connector.

Type: String to string map

Key Pattern: ([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*

Value Pattern: ([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*

Required: Yes

Compression

Specifies how the data is compressed. This is generally not necessary if the data has a standard file extension. Possible values are "gzip" and "bzip").

Type: String

Valid Values: gzip | lzo | uncompressed | snappy

Required: Yes

Format

Specifies the data output format for the target.

Type: String

Valid Values: json | csv | avro | orc | parquet | hudi | delta

Required: Yes

Inputs

The nodes that are inputs to the data target.

Type: Array of strings

Array Members: Fixed number of 1 item.

Pattern: [A-Za-z0-9_-]*

Required: Yes

Name

The name of the data target.

Type: String

Pattern: ([^\r\n])*

Required: Yes

Path

The Amazon S3 path of your Hudi data source to write to.

Type: String

Pattern: ([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*

Required: Yes

PartitionKeys

Specifies native partitioning using a sequence of keys.

Type: Array of arrays of strings

Pattern: ([\u0009\u000B\u000C\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF])*

Required: No

SchemaChangePolicy

A policy that specifies update behavior for the crawler.

Type: DirectSchemaChangePolicy object

Required: No

See Also

For more information about using this API in one of the language-specific AWS SDKs, see the following:

• AWS SDK for C++

• AWS SDK for Java V2

• AWS SDK for Ruby V3