DataProcessorProps

class aws_cdk.aws_kinesisfirehose_alpha.DataProcessorProps(*, buffer_interval=None, buffer_size=None, retries=None)

Bases: object

(experimental) Configure the data processor.

Parameters:
  • buffer_interval (Optional[Duration]) – (experimental) The length of time Kinesis Data Firehose will buffer incoming data before calling the processor. s Default: Duration.minutes(1)

  • buffer_size (Optional[Size]) – (experimental) The amount of incoming data Kinesis Data Firehose will buffer before calling the processor. Default: Size.mebibytes(3)

  • retries (Union[int, float, None]) – (experimental) The number of times Kinesis Data Firehose will retry the processor invocation after a failure due to network timeout or invocation limits. Default: 3

Stability:

experimental

ExampleMetadata:

infused

Example:

# bucket: s3.Bucket
# Provide a Lambda function that will transform records before delivery, with custom
# buffering and retry configuration
lambda_function = lambda_.Function(self, "Processor",
    runtime=lambda_.Runtime.NODEJS_LATEST,
    handler="index.handler",
    code=lambda_.Code.from_asset(path.join(__dirname, "process-records"))
)
lambda_processor = firehose.LambdaFunctionProcessor(lambda_function,
    buffer_interval=Duration.minutes(5),
    buffer_size=Size.mebibytes(5),
    retries=5
)
s3_destination = destinations.S3Bucket(bucket,
    processor=lambda_processor
)
firehose.DeliveryStream(self, "Delivery Stream",
    destinations=[s3_destination]
)

Attributes

buffer_interval

(experimental) The length of time Kinesis Data Firehose will buffer incoming data before calling the processor.

s

Default:

Duration.minutes(1)

Stability:

experimental

buffer_size

(experimental) The amount of incoming data Kinesis Data Firehose will buffer before calling the processor.

Default:

Size.mebibytes(3)

Stability:

experimental

retries

(experimental) The number of times Kinesis Data Firehose will retry the processor invocation after a failure due to network timeout or invocation limits.

Default:

3

Stability:

experimental