Amazon Kinesis Data Analytics
Developer Guide

Limits

When working with Amazon Kinesis Data Analytics, note the following limits:

  • The size of a row in an in-application stream is limited to 512 KB. Kinesis Data Analytics uses up to 1 KB to store metadata. This metadata counts against the row limit.

     

  • The SQL code in an application is limited to 100 KB.

     

  • The service is available in specific AWS Regions. For more information, see Amazon Kinesis Data Analytics in the AWS General Reference.

     

  • You can create up to 50 Kinesis Data Analytics applications per AWS Region in your account. You can create a case to request additional applications via the service limit increase form. For more information, see the AWS Support Center.

     

  • The maximum amount of source parallelism is 64. That is, in your application input configuration, you can request the mapping of a streaming source to up to 64 in-application streams.

     

  • The number of Kinesis processing units (KPU) is limited to eight. For instructions on how to request an increase to this limit, see To request a limit increase in AWS Service Limits.

     

    With Kinesis Data Analytics, you pay only for what you use. You are charged an hourly rate based on the average number of KPUs that are used to run your stream-processing application. A single KPU provides you with 1 vCPU and 4 GB of memory.

     

  • Each application can have one streaming source and up to one reference data source.

     

  • You can configure up to three destinations for your Kinesis Data Analytics application. We recommend that you use one of these destinations to persist in-application error stream data.

     

  • The Amazon S3 object that stores reference data can be up to 1 GB in size.

     

  • If you change the reference data that is stored in the S3 bucket after you upload reference data to an in-application table, you need to use the UpdateApplication operation (using the API or AWS CLI) to refresh the data in the in-application table. Currently, the AWS Management Console doesn't support refreshing reference data in your application.

     

  • Currently, Kinesis Data Analytics doesn't support data generated by the Amazon Kinesis Producer Library (KPL).