For new projects, we recommend that you use the new Managed Service for Apache Flink Studio over Kinesis Data Analytics for SQL Applications. Managed Service for Apache Flink Studio combines ease of use with advanced analytical capabilities, enabling you to build sophisticated stream processing applications in minutes.
Working with the SQL Editor
Following, you can find information about sections of the SQL editor and how each works. In the SQL editor, you can either author your own code yourself or choose Add SQL from templates. A SQL template gives you example SQL code that can help you write common Amazon Kinesis Data Analytics applications. The example applications in this guide use some of these templates. For more information, see Kinesis Data Analytics for SQL examples.
Source Data Tab
The Source data tab identifies a streaming source. It also identifies the in-application input stream that this source maps to and that provides the application input configuration.
Amazon Kinesis Data Analytics provides the following timestamp columns, so that you don't need to provide explicit mapping in your input configuration:
-
ROWTIME – Each row in an in-application stream has a special column called
ROWTIME
. This column is the timestamp for the point when Kinesis Data Analytics inserted the row in the first in-application stream. -
Approximate_Arrival_Time – Records on your streaming source include the
Approximate_Arrival_Timestamp
column. It is the approximate arrival timestamp that is set when the streaming source successfully receives and stores the related record. Kinesis Data Analytics fetches this column into the in-application input stream asApproximate_Arrival_Time
. Amazon Kinesis Data Analytics provides this column only in the in-application input stream that is mapped to the streaming source.
These timestamp values are useful in windowed queries that are time-based. For more information, see Windowed Queries.
Real-Time Analytics Tab
The Real-time analytics tab shows all the
in-application streams that your application code creates. This group of streams
includes the error stream (error_stream
) that Amazon Kinesis Data Analytics provides for
all applications.
Destination Tab
The Destination tab enables you to configure the application output to persist in-application streams to external destinations. You can configure output to persist data in any of the in-application streams to external destinations. For more information, see Configuring Application Output.