StorageDescriptor - AWS Glue

StorageDescriptor

Describes the physical storage of table data.

Contents

AdditionalLocations

A list of locations that point to the path where a Delta table is located.

Type: Array of strings

Length Constraints: Maximum length of 2056.

Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*

Required: No

BucketColumns

A list of reducer grouping columns, clustering columns, and bucketing columns in the table.

Type: Array of strings

Length Constraints: Minimum length of 1. Maximum length of 255.

Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\t]*

Required: No

Columns

A list of the Columns in the table.

Type: Array of Column objects

Required: No

Compressed

True if the data in the table is compressed, or False if not.

Type: Boolean

Required: No

InputFormat

The input format: SequenceFileInputFormat (binary), or TextInputFormat, or a custom format.

Type: String

Length Constraints: Maximum length of 128.

Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\t]*

Required: No

Location

The physical location of the table. By default, this takes the form of the warehouse location, followed by the database location in the warehouse, followed by the table name.

Type: String

Length Constraints: Maximum length of 2056.

Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\r\n\t]*

Required: No

NumberOfBuckets

Must be specified if the table contains any dimension columns.

Type: Integer

Required: No

OutputFormat

The output format: SequenceFileOutputFormat (binary), or IgnoreKeyTextOutputFormat, or a custom format.

Type: String

Length Constraints: Maximum length of 128.

Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\t]*

Required: No

Parameters

The user-supplied properties in key-value form.

Type: String to string map

Key Length Constraints: Minimum length of 1. Maximum length of 255.

Key Pattern: [\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF\t]*

Value Length Constraints: Maximum length of 512000.

Required: No

SchemaReference

An object that references a schema stored in the AWS Glue Schema Registry.

When creating a table, you can pass an empty list of columns for the schema, and instead use a schema reference.

Type: SchemaReference object

Required: No

SerdeInfo

The serialization/deserialization (SerDe) information.

Type: SerDeInfo object

Required: No

SkewedInfo

The information about values that appear frequently in a column (skewed values).

Type: SkewedInfo object

Required: No

SortColumns

A list specifying the sort order of each bucket in the table.

Type: Array of Order objects

Required: No

StoredAsSubDirectories

True if the table data is stored in subdirectories, or False if not.

Type: Boolean

Required: No

See Also

For more information about using this API in one of the language-specific AWS SDKs, see the following: