Class DataFormat
(experimental) Defines the input/output formats and ser/de for a single DataFormat.
Inheritance
Namespace: Amazon.CDK.AWS.Glue
Assembly: Amazon.CDK.AWS.Glue.dll
Syntax (csharp)
public class DataFormat : DeputyBase
Syntax (vb)
Public Class DataFormat
Inherits DeputyBase
Remarks
Stability: Experimental
ExampleMetadata: infused
Examples
Database myDatabase;
new Table(this, "MyTable", new TableProps {
Database = myDatabase,
TableName = "my_table",
Columns = new [] { new Column {
Name = "col1",
Type = Schema.STRING
} },
PartitionKeys = new [] { new Column {
Name = "year",
Type = Schema.SMALL_INT
}, new Column {
Name = "month",
Type = Schema.SMALL_INT
} },
DataFormat = DataFormat.JSON
});
Synopsis
Constructors
DataFormat(IDataFormatProps) | |
DataFormat(ByRefValue) | Used by jsii to construct an instance of this class from a Javascript-owned object reference |
DataFormat(DeputyBase.DeputyProps) | Used by jsii to construct an instance of this class from DeputyProps |
Properties
APACHE_LOGS | (experimental) DataFormat for Apache Web Server Logs. |
AVRO | (experimental) DataFormat for Apache Avro. |
ClassificationString | (experimental) Classification string given to tables with this data format. |
CLOUDTRAIL_LOGS | (experimental) DataFormat for CloudTrail logs stored on S3. |
CSV | (experimental) DataFormat for CSV Files. |
InputFormat | (experimental) |
JSON | (experimental) Stored as plain text files in JSON format. |
LOGSTASH | (experimental) DataFormat for Logstash Logs, using the GROK SerDe. |
ORC | (experimental) DataFormat for Apache ORC (Optimized Row Columnar). |
OutputFormat | (experimental) |
PARQUET | (experimental) DataFormat for Apache Parquet. |
SerializationLibrary | (experimental) Serialization library for this data format. |
TSV | (experimental) DataFormat for TSV (Tab-Separated Values). |
Constructors
DataFormat(IDataFormatProps)
public DataFormat(IDataFormatProps props)
Parameters
- props IDataFormatProps
Remarks
Stability: Experimental
DataFormat(ByRefValue)
Used by jsii to construct an instance of this class from a Javascript-owned object reference
protected DataFormat(ByRefValue reference)
Parameters
- reference Amazon.JSII.Runtime.Deputy.ByRefValue
The Javascript-owned object reference
DataFormat(DeputyBase.DeputyProps)
Used by jsii to construct an instance of this class from DeputyProps
protected DataFormat(DeputyBase.DeputyProps props)
Parameters
- props Amazon.JSII.Runtime.Deputy.DeputyBase.DeputyProps
The deputy props
Properties
APACHE_LOGS
(experimental) DataFormat for Apache Web Server Logs.
public static DataFormat APACHE_LOGS { get; }
Property Value
Remarks
Also works for CloudFront logs
Stability: Experimental
See: https://docs.aws.amazon.com/athena/latest/ug/apache.html
AVRO
(experimental) DataFormat for Apache Avro.
public static DataFormat AVRO { get; }
Property Value
Remarks
Stability: Experimental
ClassificationString
(experimental) Classification string given to tables with this data format.
public virtual ClassificationString ClassificationString { get; }
Property Value
Remarks
Stability: Experimental
CLOUDTRAIL_LOGS
(experimental) DataFormat for CloudTrail logs stored on S3.
public static DataFormat CLOUDTRAIL_LOGS { get; }
Property Value
Remarks
Stability: Experimental
See: https://docs.aws.amazon.com/athena/latest/ug/cloudtrail.html
CSV
(experimental) DataFormat for CSV Files.
public static DataFormat CSV { get; }
Property Value
Remarks
Stability: Experimental
InputFormat
(experimental) InputFormat
for this data format.
public virtual InputFormat InputFormat { get; }
Property Value
Remarks
Stability: Experimental
JSON
(experimental) Stored as plain text files in JSON format.
public static DataFormat JSON { get; }
Property Value
Remarks
Uses OpenX Json SerDe for serialization and deseralization.
Stability: Experimental
LOGSTASH
(experimental) DataFormat for Logstash Logs, using the GROK SerDe.
public static DataFormat LOGSTASH { get; }
Property Value
Remarks
Stability: Experimental
ORC
(experimental) DataFormat for Apache ORC (Optimized Row Columnar).
public static DataFormat ORC { get; }
Property Value
Remarks
Stability: Experimental
OutputFormat
(experimental) OutputFormat
for this data format.
public virtual OutputFormat OutputFormat { get; }
Property Value
Remarks
Stability: Experimental
PARQUET
(experimental) DataFormat for Apache Parquet.
public static DataFormat PARQUET { get; }
Property Value
Remarks
Stability: Experimental
See: https://docs.aws.amazon.com/athena/latest/ug/parquet.html
SerializationLibrary
(experimental) Serialization library for this data format.
public virtual SerializationLibrary SerializationLibrary { get; }
Property Value
Remarks
Stability: Experimental
TSV
(experimental) DataFormat for TSV (Tab-Separated Values).
public static DataFormat TSV { get; }
Property Value
Remarks
Stability: Experimental
See: https://docs.aws.amazon.com/athena/latest/ug/lazy-simple-serde.html