Describes an update for a destination in Apache Iceberg Tables.
Contents
- AppendOnly
-
Describes whether all incoming data for this delivery stream will be append only (inserts only and not for updates and deletes) for Iceberg delivery. This feature is only applicable for Apache Iceberg Tables.
The default value is false. If you set this value to true, Firehose automatically increases the throughput limit of a stream based on the throttling levels of the stream. If you set this parameter to true for a stream with updates and deletes, you will see out of order delivery.
Type: Boolean
Required: No
- BufferingHints
-
Describes hints for the buffering to perform before delivering data to the destination. These options are treated as hints, and therefore Firehose might choose to use different values when it is optimal. The
SizeInMBsandIntervalInSecondsparameters are optional. However, if specify a value for one of them, you must also provide a value for the other.Type: BufferingHints object
Required: No
- CatalogConfiguration
-
Configuration describing where the destination Iceberg tables are persisted.
Type: CatalogConfiguration object
Required: No
- CloudWatchLoggingOptions
-
Describes the Amazon CloudWatch logging options for your Firehose stream.
Type: CloudWatchLoggingOptions object
Required: No
- DestinationTableConfigurationList
-
Provides a list of
DestinationTableConfigurationswhich Firehose uses to deliver data to Apache Iceberg Tables. Firehose will write data with insert if table specific configuration is not provided here.Type: Array of DestinationTableConfiguration objects
Required: No
- ProcessingConfiguration
-
Describes a data processing configuration.
Type: ProcessingConfiguration object
Required: No
- RetryOptions
-
The retry behavior in case Firehose is unable to deliver data to a destination.
Type: RetryOptions object
Required: No
- RoleARN
-
The Amazon Resource Name (ARN) of the IAM role to be assumed by Firehose for calling Apache Iceberg Tables.
Type: String
Length Constraints: Minimum length of 1. Maximum length of 512.
Pattern:
arn:.*:iam::\d{12}:role/[a-zA-Z_0-9+=,.@\-_/]+Required: No
- S3BackupMode
-
Describes how Firehose will backup records. Currently,Firehose only supports
FailedDataOnly.Type: String
Valid Values:
FailedDataOnly | AllDataRequired: No
- S3Configuration
-
Describes the configuration of a destination in Amazon S3.
Type: S3DestinationConfiguration object
Required: No
- SchemaEvolutionConfiguration
-
The configuration to enable automatic schema evolution.
Amazon Data Firehose is in preview release and is subject to change.
Type: SchemaEvolutionConfiguration object
Required: No
- TableCreationConfiguration
-
The configuration to enable automatic table creation.
Amazon Data Firehose is in preview release and is subject to change.
Type: TableCreationConfiguration object
Required: No
See Also
For more information about using this API in one of the language-specific AWS SDKs, see the following:
