Working with the SQL Editor - Amazon Kinesis Data Analytics for SQL Applications Developer Guide

For new projects, we recommend that you use the new Managed Service for Apache Flink Studio over Kinesis Data Analytics for SQL Applications. Managed Service for Apache Flink Studio combines ease of use with advanced analytical capabilities, enabling you to build sophisticated stream processing applications in minutes.

Working with the SQL Editor

Following, you can find information about sections of the SQL editor and how each works. In the SQL editor, you can either author your own code yourself or choose Add SQL from templates. A SQL template gives you example SQL code that can help you write common Amazon Kinesis Data Analytics applications. The example applications in this guide use some of these templates. For more information, see Kinesis Data Analytics for SQL examples.


                    Screenshot of the SQL editor showing the real-time analytics tab and
                        in-application streams.

Source Data Tab

The Source data tab identifies a streaming source. It also identifies the in-application input stream that this source maps to and that provides the application input configuration.


                        Screenshot of the SQL editor showing the source data tab with the
                            streaming source highlighted.

Amazon Kinesis Data Analytics provides the following timestamp columns, so that you don't need to provide explicit mapping in your input configuration:

  • ROWTIME – Each row in an in-application stream has a special column called ROWTIME. This column is the timestamp for the point when Kinesis Data Analytics inserted the row in the first in-application stream.

  • Approximate_Arrival_Time – Records on your streaming source include the Approximate_Arrival_Timestamp column. It is the approximate arrival timestamp that is set when the streaming source successfully receives and stores the related record. Kinesis Data Analytics fetches this column into the in-application input stream as Approximate_Arrival_Time. Amazon Kinesis Data Analytics provides this column only in the in-application input stream that is mapped to the streaming source.

These timestamp values are useful in windowed queries that are time-based. For more information, see Windowed Queries.

Real-Time Analytics Tab

The Real-time analytics tab shows all the in-application streams that your application code creates. This group of streams includes the error stream (error_stream) that Amazon Kinesis Data Analytics provides for all applications.


                        Screenshot of the SQL editor showing the real-time analytics tab
                            with in-application streams highlighted.

Destination Tab

The Destination tab enables you to configure the application output to persist in-application streams to external destinations. You can configure output to persist data in any of the in-application streams to external destinations. For more information, see Configuring Application Output.