IcebergDestinationUpdate - Amazon Data Firehose

IcebergDestinationUpdate

Describes an update for a destination in Apache Iceberg Tables.

Contents

BufferingHints

Describes hints for the buffering to perform before delivering data to the destination. These options are treated as hints, and therefore Firehose might choose to use different values when it is optimal. The SizeInMBs and IntervalInSeconds parameters are optional. However, if specify a value for one of them, you must also provide a value for the other.

Type: BufferingHints object

Required: No

CatalogConfiguration

Configuration describing where the destination Iceberg tables are persisted.

Type: CatalogConfiguration object

Required: No

CloudWatchLoggingOptions

Describes the Amazon CloudWatch logging options for your Firehose stream.

Type: CloudWatchLoggingOptions object

Required: No

DestinationTableConfigurationList

Provides a list of DestinationTableConfigurations which Firehose uses to deliver data to Apache Iceberg Tables. Firehose will write data with insert if table specific configuration is not provided here.

Type: Array of DestinationTableConfiguration objects

Required: No

ProcessingConfiguration

Describes a data processing configuration.

Type: ProcessingConfiguration object

Required: No

RetryOptions

The retry behavior in case Firehose is unable to deliver data to a destination.

Type: RetryOptions object

Required: No

RoleARN

The Amazon Resource Name (ARN) of the IAM role to be assumed by Firehose for calling Apache Iceberg Tables.

Type: String

Length Constraints: Minimum length of 1. Maximum length of 512.

Pattern: arn:.*:iam::\d{12}:role/[a-zA-Z_0-9+=,.@\-_/]+

Required: No

S3BackupMode

Describes how Firehose will backup records. Currently,Firehose only supports FailedDataOnly.

Type: String

Valid Values: FailedDataOnly | AllData

Required: No

S3Configuration

Describes the configuration of a destination in Amazon S3.

Type: S3DestinationConfiguration object

Required: No

SchemaEvolutionConfiguration

The configuration to enable automatic schema evolution.

Amazon Data Firehose is in preview release and is subject to change.

Type: SchemaEvolutionConfiguration object

Required: No

TableCreationConfiguration

The configuration to enable automatic table creation.

Amazon Data Firehose is in preview release and is subject to change.

Type: TableCreationConfiguration object

Required: No

See Also

For more information about using this API in one of the language-specific AWS SDKs, see the following: