Document history for Amazon MSK Developer Guide - Amazon Managed Streaming for Apache Kafka

Document history for Amazon MSK Developer Guide

The following table describes the important changes to the Amazon MSK Developer Guide.

Latest documentation update: February 07, 2024

Change Description Date
WriteDataIdempotently added to AWSMSKReplicatorExecutionRole

WriteDataIdempotently permission is added to AWSMSKReplicatorExecutionRole policy to support data replication between MSK clusters.

2024-3-12

Graviton M7g brokers released in Brazil and Bahrain.

Amazon MSK now supports South America (sa-east-1, São Paulo) and Middle East (me-south-1, Bahrain) region availability of M7g brokers using AWS Graviton processors (custom Arm-based processors built by Amazon Web Services).

2024-2-07

Release Graviton M7g brokers to China region Amazon MSK now supports China region availability of M7g brokers using AWS Graviton processors (custom Arm-based processors built by Amazon Web Services).

2024-01-11

Amazon MSK Kafka version support policy

Added explanation of the Amazon MSK supported Kafka version support policy. For more information, see Apache Kafka versions.

2023-12-08

New service execution role policy to support Amazon MSK Replicator.

Amazon MSK added new AWSMSKReplicatorExecutionRole policy to support Amazon MSK Replicator. For more information, see AWS managed policy: AWSMSKReplicatorExecutionRole.

2023-12-06

M7g Graviton support

Amazon MSK now supports M7g brokers using AWS Graviton processors (custom Arm-based processors built by Amazon Web Services).

2023-11-27

Amazon MSK Replicator

Amazon MSK Replicator is a new feature that you can use to replicate data between Amazon MSK clusters. Amazon MSK Replicator includes an update to the AmazonMSKFullAccess policy. For more information, see AWS managed policy: AmazonMSKFullAccess.

2023-09-28

Updated for IAM best practices.

Updated guide to align with the IAM best practices. For more information, see Security best practices in IAM.

2023-03-08

Service-linked role updates to support multi-VPC private connectivity

Amazon MSK now includes AWSServiceRoleForKafka service-linked role updates to manage network interfaces and VPC endpoints in your account that make cluster brokers accessible to clients in your VPC. Amazon MSK uses permissions to DescribeVpcEndpoints, ModifyVpcEndpoint and DeleteVpcEndpoints. For more information, see Using service-linked roles for Amazon MSK.

2023-03-08

Support for Apache Kafka 2.7.2

Amazon MSK now supports Apache Kafka version 2.7.2. For more information, see Supported Apache Kafka versions.

2021-12-21

Support for Apache Kafka 2.6.3

Amazon MSK now supports Apache Kafka version 2.6.3. For more information, see Supported Apache Kafka versions.

2021-12-21

MSK Serverless Prerelease

MSK Serverless is a new feature that you can use to create serverless clusters. For more information, see MSK Serverless.

2021-11-29

Support for Apache Kafka 2.8.1

Amazon MSK now supports Apache Kafka version 2.8.1. For more information, see Supported Apache Kafka versions.

2021-09-30

MSK Connect

MSK Connect is a new feature that you can use to create and manage Apache Kafka connectors. For more information, see MSK Connect.

2021-09-16

Support for Apache Kafka 2.7.1

Amazon MSK now supports Apache Kafka version 2.7.1. For more information, see Supported Apache Kafka versions.

2021-05-25

Support for Apache Kafka 2.8.0

Amazon MSK now supports Apache Kafka version 2.8.0. For more information, see Supported Apache Kafka versions.

2021-04-28

Support for Apache Kafka 2.6.2

Amazon MSK now supports Apache Kafka version 2.6.2. For more information, see Supported Apache Kafka versions.

2021-04-28

Support for Updating Broker Type

You can now change the broker type for an existing cluster. For more information, see Updating the broker type.

2021-01-21

Support for Apache Kafka 2.6.1

Amazon MSK now supports Apache Kafka version 2.6.1. For more information, see Supported Apache Kafka versions.

2021-01-19

Support for Apache Kafka 2.7.0

Amazon MSK now supports Apache Kafka version 2.7.0. For more information, see Supported Apache Kafka versions.

2020-12-29

No New Clusters with Apache Kafka Version 1.1.1 You can no longer create a new Amazon MSK cluster with Apache Kafka version 1.1.1. However, if you have existing MSK clusters that are running Apache Kafka version 1.1.1, you can continue using all of the currently-supported features on those existing clusters. For more information, see Apache Kafka versions.

2020-11-24

Consumer-Lag Metrics

Amazon MSK now provides metrics that you can use to monitor consumer lag. For more information, see Monitoring an Amazon MSK cluster.

2020-11-23

Support for Cruise Control

Amazon MSK now supports LinkedIn's Cruise Control. For more information, see Using LinkedIn's Cruise Control for Apache Kafka with Amazon MSK.

2020-11-17

Support for Apache Kafka 2.6.0

Amazon MSK now supports Apache Kafka version 2.6.0. For more information, see Supported Apache Kafka versions.

2020-10-21

Support for Apache Kafka 2.5.1

Amazon MSK now supports Apache Kafka version 2.5.1. With Apache Kafka version 2.5.1, Amazon MSK supports encryption in transit between clients and ZooKeeper endpoints. For more information, see Supported Apache Kafka versions.

2020-09-30

Application Auto-Expansion

You can configure Amazon Managed Streaming for Apache Kafka to automatically expand your cluster's storage in response to increased usage. For more information, see Automatic scaling.

2020-09-30

Support for Username and Password Security

Amazon MSK now supports logging into clusters using a username and password. Amazon MSK stores credentials in AWS Secrets Manager. For more information, see SASL/SCRAM authentication.

2020-09-17

Support for Upgrading the Apache Kafka Version of an Amazon MSK Cluster

You can now upgrade the Apache Kafka version of an existing MSK cluster.

2020-05-28

Support for T3.small Broker Nodes

Amazon MSK now supports creating clusters with brokers of Amazon EC2 type T3.small.

2020-04-08

Support for Apache Kafka 2.4.1

Amazon MSK now supports Apache Kafka version 2.4.1.

2020-04-02

Support for Streaming Broker Logs Amazon MSK can now stream broker logs to CloudWatch Logs, Amazon S3, and Amazon Data Firehose. Firehose can, in turn, deliver these logs to the destinations that it supports, such as OpenSearch Service.

2020-02-25

Support for Apache Kafka 2.3.1

Amazon MSK now supports Apache Kafka version 2.3.1.

2019-12-19

Open Monitoring

Amazon MSK now supports open monitoring with Prometheus.

2019-12-04

Support for Apache Kafka 2.2.1

Amazon MSK now supports Apache Kafka version 2.2.1.

2019-07-31

General Availability

New features include tagging support, authentication, TLS encryption, configurations, and the ability to update broker storage.

2019-05-30

Support for Apache Kafka 2.1.0

Amazon MSK now supports Apache Kafka version 2.1.0.

2019-02-05