AWS::DataBrew::Job Output

Represents options that specify how and where in Amazon S3 DataBrew writes the output generated by recipe jobs or profile jobs.

Syntax

To declare this entity in your AWS CloudFormation template, use the following syntax:

JSON

{
  "CompressionFormat" : String,
  "Format" : String,
  "FormatOptions" : OutputFormatOptions,
  "Location" : S3Location,
  "MaxOutputFiles" : Integer,
  "Overwrite" : Boolean,
  "PartitionColumns" : [ String, ... ]
}

YAML

  CompressionFormat: String
  Format: String
  FormatOptions: 
    OutputFormatOptions
  Location: 
    S3Location
  MaxOutputFiles: Integer
  Overwrite: Boolean
  PartitionColumns: 
    - String

Properties

CompressionFormat

The compression algorithm used to compress the output text of the job.

Required: No

Type: String

Allowed values: GZIP | LZ4 | SNAPPY | BZIP2 | DEFLATE | LZO | BROTLI | ZSTD | ZLIB

Update requires: No interruption

Format

The data format of the output of the job.

Required: No

Type: String

Allowed values: CSV | JSON | PARQUET | GLUEPARQUET | AVRO | ORC | XML | TABLEAUHYPER

Update requires: No interruption

FormatOptions

Represents options that define how DataBrew formats job output files.

Required: No

Type: OutputFormatOptions

Update requires: No interruption

Location

The location in Amazon S3 where the job writes its output.

Required: Yes

Type: S3Location

Update requires: No interruption

MaxOutputFiles

The maximum number of files to be generated by the job and written to the output folder.

Required: No

Type: Integer

Minimum: 1

Maximum: 999

Update requires: No interruption

Overwrite

A value that, if true, means that any data in the location specified for output is overwritten with new output.

Required: No

Type: Boolean

Update requires: No interruption

PartitionColumns

The names of one or more partition columns for the output of the job.

Required: No

Type: Array of String

Maximum: 200

Update requires: No interruption