AWS SDK for Go (PILOT)
API Reference

PREVIEW DOCUMENTATION - This is a preview of a new format for the AWS SDK for Go API Reference documentation. For the current AWS SDK for Go API Reference, see https://docs.aws.amazon.com/sdk-for-go/api/.

We welcome your feedback on this new version of the documentation. Send your comments to aws-sdkdocs-feedback@amazon.com.

ParquetSerDe

import "github.com/aws/aws-sdk-go/service/firehose"

type ParquetSerDe struct { BlockSizeBytes *int64 `min:"6.7108864e+07" type:"integer"` Compression *string `type:"string" enum:"ParquetCompression"` EnableDictionaryCompression *bool `type:"boolean"` MaxPaddingBytes *int64 `type:"integer"` PageSizeBytes *int64 `min:"65536" type:"integer"` WriterVersion *string `type:"string" enum:"ParquetWriterVersion"` }

A serializer to use for converting data to the Parquet format before storing it in Amazon S3. For more information, see Apache Parquet (https://parquet.apache.org/documentation/latest/).

BlockSizeBytes

Type: *int64

The Hadoop Distributed File System (HDFS) block size. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 256 MiB and the minimum is 64 MiB. Kinesis Data Firehose uses this value for padding calculations.

Compression

Type: *string

The compression code to use over data blocks. The possible values are UNCOMPRESSED, SNAPPY, and GZIP, with the default being SNAPPY. Use SNAPPY for higher decompression speed. Use GZIP if the compression ration is more important than speed.

EnableDictionaryCompression

Type: *bool

Indicates whether to enable dictionary compression.

MaxPaddingBytes

Type: *int64

The maximum amount of padding to apply. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 0.

PageSizeBytes

Type: *int64

The Parquet page size. Column chunks are divided into pages. A page is conceptually an indivisible unit (in terms of compression and encoding). The minimum value is 64 KiB and the default is 1 MiB.

WriterVersion

Type: *string

Indicates the version of row format to output. The possible values are V1 and V2. The default is V1.

Method

GoString

func (s ParquetSerDe) GoString() string

GoString returns the string representation

SetBlockSizeBytes

func (s *ParquetSerDe) SetBlockSizeBytes(v int64) *ParquetSerDe

SetBlockSizeBytes sets the BlockSizeBytes field's value.

SetCompression

func (s *ParquetSerDe) SetCompression(v string) *ParquetSerDe

SetCompression sets the Compression field's value.

SetEnableDictionaryCompression

func (s *ParquetSerDe) SetEnableDictionaryCompression(v bool) *ParquetSerDe

SetEnableDictionaryCompression sets the EnableDictionaryCompression field's value.

SetMaxPaddingBytes

func (s *ParquetSerDe) SetMaxPaddingBytes(v int64) *ParquetSerDe

SetMaxPaddingBytes sets the MaxPaddingBytes field's value.

SetPageSizeBytes

func (s *ParquetSerDe) SetPageSizeBytes(v int64) *ParquetSerDe

SetPageSizeBytes sets the PageSizeBytes field's value.

SetWriterVersion

func (s *ParquetSerDe) SetWriterVersion(v string) *ParquetSerDe

SetWriterVersion sets the WriterVersion field's value.

String

func (s ParquetSerDe) String() string

String returns the string representation

Validate

func (s *ParquetSerDe) Validate() error

Validate inspects the fields of the type to determine if they are valid.

On this page: