Menu
Streaming Analytics Pipeline
Streaming Analytics Pipeline

Appendix A: Modify Destination Parameters

If you select Amazon Redshift, Amazon Elasticsearch Service, or an Kinesis stream as the destination for your analyzed data, you must modify the parameter for your selected destination.

For Amazon Redshift, modify the parameters in the following table.

Parameter Default Description
Master User Name <Requires input> Username of the user with permissions to edit the specified table in the Amazon Redshift cluster
Master User Password <Requires input> Password of the user with permissions to edit the specified table in the Amazon Redshift cluster
JDBC URL <Requires input> The JDBC URL of the Amazon Redshift cluster. You can obtain this from the Amazon Redshift console. The URL has the following format: jdbc:redshift://endpoint:port/database
Table Name <Requires input> The name of an existing, preconfigured table in the specified Amazon Redshift cluster, to which the results of the Amazon Kinesis Analytics application will be loaded
Column Pattern <Requires input> By default, Amazon Kinesis Firehose will copy records to Amazon Redshift in the same order they leave the Amazon Kinesis Analytics application. If you wish to change the order or enter analyzed data into certain columns, provide a comma-separated list of the column names in the desired order. For example, column1, column2, column3, column4.
Buffer Interval 300 Specify the number of seconds (60-900) that Amazon Kinesis Firehose should buffer data before loading it to Amazon Redshift
Buffer Size 5 Specify the size of data in MB (1-128) that Amazon Kinesis Firehose should buffer before loading it to Amazon Redshift

For Amazon Elasticsearch Service, modify the parameters in the following table.

Parameter Default Description
Domain Name <Requires input> The name of the Amazon Elasticsearch Service domain. You must deploy the solution in the same AWS Region as the domain.
Index Name <Requires input> The name of the index for analyzed data
Type Name <Requires input> The name of the type for analyzed data. We recommend that you create the type before you start the Amazon Kinesis Analytics application.
Index Rotation NoRotation The frequency at which the specified Amazon Elasticsearch Service index rotates
Buffer Interval 300 Specify the number of seconds (60-900) that Amazon Kinesis Firehose should buffer data before loading it to Amazon Elasticsearch Service
Buffer Size 5 Specify the size of data in MB (1-128) that Amazon Kinesis Firehose should buffer before loading it to Amazon Elasticsearch Service

For an Kinesis stream, modify the Destination Stream Name parameter. The Destination Stream Name is the name of the stream that will be your destination for your analyzed data.