Skip to content
v2.275.0

RecordDeAggregationProcessor Class ​

The data processor for multi record deaggrecation.

Record deaggregation by JSON or by delimiter is capped at 500 per record.

Example ​

ts
declare const bucket: s3.Bucket;
const s3Destination = new firehose.S3Bucket(bucket, {
  dynamicPartitioning: { enabled: true },
  processors: [
    firehose.RecordDeAggregationProcessor.json(),
  ],
});
python
# bucket: s3.Bucket

s3_destination = firehose.S3Bucket(bucket,
    dynamic_partitioning=firehose.DynamicPartitioningProps(enabled=True),
    processors=[
        firehose.RecordDeAggregationProcessor.json()
    ]
)
java
Bucket bucket;

S3Bucket s3Destination = S3Bucket.Builder.create(bucket)
        .dynamicPartitioning(DynamicPartitioningProps.builder().enabled(true).build())
        .processors(List.of(RecordDeAggregationProcessor.json()))
        .build();
csharp
// Install: dotnet add package Amazon.CDK.Lib
Bucket bucket;

var s3Destination = new S3Bucket(bucket, new S3BucketProps {
    DynamicPartitioning = new DynamicPartitioningProps { Enabled = true },
    Processors = new [] { RecordDeAggregationProcessor.Json() }
});
go
// Install: go get github.com/aws/aws-cdk-go/awscdk/v2
var bucket Bucket

s3Destination := firehose.NewS3Bucket(bucket, &S3BucketProps{
	DynamicPartitioning: &DynamicPartitioningProps{
		Enabled: jsii.Boolean(true),
	},
	Processors: []IDataProcessor{
		firehose.RecordDeAggregationProcessor_Json(),
	},
})

Initializer ​

ts
new RecordDeAggregationProcessor(options: RecordDeAggregationProcessorOptions)
python
RecordDeAggregationProcessor(options: RecordDeAggregationProcessorOptions)
java
new RecordDeAggregationProcessor(RecordDeAggregationProcessorOptions options)
csharp
new RecordDeAggregationProcessor(RecordDeAggregationProcessorOptions options)
go
NewRecordDeAggregationProcessor(Options RecordDeAggregationProcessorOptions)

Properties ​

The constructor props of the DataProcessor.

Methods ​

bind(scope: Construct, options: DataProcessorBindOptions): DataProcessorConfigdef bind(self, scope: Construct, options: DataProcessorBindOptions) -> DataProcessorConfigpublic DataProcessorConfig bind(Construct scope, DataProcessorBindOptions options)public DataProcessorConfig Bind(Construct scope, DataProcessorBindOptions options)func Bind(Scope Construct, Options DataProcessorBindOptions) DataProcessorConfig#
Binds this processor to a destination of a delivery stream.

Implementers should use this method to grant processor invocation permissions to the provided stream and return the necessary configuration to register as a processor.

delimited(delimiter: string): RecordDeAggregationProcessor // chainable@staticmethod def delimited(delimiter: str) -> RecordDeAggregationProcessorpublic static RecordDeAggregationProcessor delimited(String delimiter)public static RecordDeAggregationProcessor Delimited(string delimiter)func Delimited(Delimiter *string) RecordDeAggregationProcessorstatic#
Perform deaggregation based on a specified custom delimiter.
1 parameter

Parameters

  • delimiterdelimiterdelimiterdelimiterDelimiter — The custom delimiter.
json(): RecordDeAggregationProcessor // chainable@staticmethod def json() -> RecordDeAggregationProcessorpublic static RecordDeAggregationProcessor json()public static RecordDeAggregationProcessor Json()func Json() RecordDeAggregationProcessorstatic#
Perform deaggregation from JSON objects on a single line with no delimiter or newline-delimited (JSONL).