DropDuplicates - AWS Glue

DropDuplicates

Specifies a transform that removes rows of repeating data from a data set.

Contents

Inputs

The data inputs identified by their node names.

Type: Array of strings

Array Members: Fixed number of 1 item.

Pattern: [A-Za-z0-9_-]*

Required: Yes

Name

The name of the transform node.

Type: String

Pattern: ([\u0020-\uD7FF\uE000-\uFFFD\uD800\uDC00-\uDBFF\uDFFF]|[^\r\n])*

Required: Yes

Columns

The name of the columns to be merged or removed if repeating.

Type: Array of arrays of strings

Pattern: [A-Za-z0-9_-]*

Required: No

See Also

For more information about using this API in one of the language-specific AWS SDKs, see the following: