Data Movement, Ingestion, Analysis, and Storage

AWS provides you with managed services to help you ingest network data at scale, and move, analyze, and store the data. Amazon Managed Streaming for Apache Kafka (Amazon MSK) provides you with a path to migrate your Kafka Streams applications to AWS Cloud. Amazon MSK provides you with scaling capabilities while eliminating the effort taken to self-manage Apache Kafka brokers and its associated components.

Amazon Kinesis Data Streams (KDS) provides you with a serverless, scalable, and durable real-time data streaming service, allowing your OSS solution to ingest network events such as alarms, configuration changes, and signaling events. A Kinesis stream is comprised of one or more shard, where the latter is a uniquely-identified sequence of data records in a stream. The rate of data flowing through the stream is a function of the number of shards in a stream. Using prediction models, defined schedules, or monitored KPIs, you can perform resharding on a stream to maintain a data rate when a network condition obliges. For example, when a hurricane generates a large number of network alarms and service failures, resharding allows you to scale your stream to maintain the rate of data and support your Service Assurance applications.

AWS Glue is a serverless data integration service that enables you to discover and prepare data to support your OSS application. For example, using AWS Glue, you can transform the format of data ingested from a newly-integrated network element into a format that is suitable for your Service Assurance, Domain Management, and/or Network Analytic solution. AWS Glue helps you build applications that automatically discover network elements, network services, and north-south-east-west application inputs.

AWS provides you with purpose-built, managed database services to support your OSS data structures and transactions needs. For example, Amazon Neptune is a fully-managed graph database service that enables you to represent complex network service relationships, enabling your Service Assurance applications to detect network anomalies and misconfigurations, and provides your network engineering teams with recommendations. Amazon Aurora provides you with a MySQL and PostgreSQL-compatible relational database built for the cloud. Amazon Aurora is up to five times faster than standard MySQL databases and three times faster than standard PostgreSQL databases, providing you with the performance to enable your next-generation OSS solution.