Streaming Ingest and Stream Processing - Analytics Lens

Streaming Ingest and Stream Processing

Ingesting and processing real-time streaming data requires scalability, reliability, and low latency to support a variety of applications. These applications include activity tracking, transaction order processing, click-stream analysis, data cleansing, metrics generation, log filtering, indexing, social media analysis, IoT device data telemetry and metering. These applications are often spiky and process thousands of events per second.

With AWS, you can take advantage of the managed streaming data services offered by Amazon Kinesis, or deploy and manage your own streaming data solution in the cloud on Amazon EC2. See the definitions section for details on the streaming services that can be deployed on AWS.

Consider the following characteristics as you design your stream processing pipeline for real-time ingestion and continuous processing.