Document history for Amazon MSK Developer Guide
The following table describes the important changes to the Amazon MSK Developer Guide.
Latest documentation update: June 25, 2024
| Change | Description | Date |
|---|---|---|
| Amazon MSK Replicator launch in Asia Pacific (Hyderabad) Region | Amazon MSK now supports MSK Replicator in the Asia Pacific (Hyderabad) Region. | 2025-08-26 |
| StorageUsed metric for Express brokers | Amazon MSK now includes a new DEFAULT level metric, StorageUsed for Express brokers that provides cluster-level visibility into total storage consumption excluding replicas. For more information, see DEFAULT level monitoring for Express brokers. |
2025-07-24 |
| High partition count for Amazon MSK Express brokers | Amazon MSK launched high partition count for Express brokers. For more information, see Express broker partition quota. | 2025-07-21 |
| New Amazon MSK Connect metrics | MSK Connect added two new metrics – |
2025-06-30 |
| MSK Provisioned Getting started topics overhaul | Completely restructured the MSK Provisioned Getting started topics to improve user experience, content flow, and readability. The revised topics also include detailed documentation of all console options including storage modes, authentication methods, and monitoring levels with clear decision guidance. For more information, see Get started using Amazon MSK. |
2025-06-28 |
| Support for Express broker on Apache Kafka version 3.8.x | Amazon MSK now supports Express brokers on Apache Kafka version 3.8.x. For more information, see Amazon MSK Express brokers. | 2025-06-05 |
| New Amazon MSK Replicator troubleshooting information |
Amazon Managed Streaming for Apache Kafka Developer Guide now includes comprehensive MSK Replicator troubleshooting documentation with diagnostic script and detailed error mitigation procedures. For more information, see Troubleshoot MSK Replicator failures using ReplicatorFailure metric. |
2025-05-09 |
| Non-disruptive certificate renewals | Amazon MSK launched non-disruptive certificate renewals for Express brokers to eliminate maintenance downtime during mandatory 13-month certificate updates. For more information, see Amazon MSK encryption. | 2025-05-05 |
| Support for Apache Kafka version 4.0.x | Amazon MSK now supports Apache Kafka version 4.0.x. For more information, see Supported Apache Kafka versions. | 2025-05-02 |
| Amazon MSK Connect launch in China Regions | MSK Connect is now available in all China Regions – China (Beijing) and China (Ningxia). | 2025-04-10 |
| Support for Apache Kafka version 3.9.x | Amazon MSK now supports Apache Kafka version 3.9.x. For information, see Supported Apache Kafka versions. | 2025-04-21 |
| Amazon EventBridge Kafka sink connector for MSK Connect |
Amazon Managed Streaming for Apache Kafka Developer Guide now includes a comprehensive topic that describes how to use EventBridge Kafka sink connector with MSK Connect. For more information, see Set up EventBridge Kafka sink connector for MSK Connect. |
2025-03-28 |
| Express brokers quotas update |
Amazon Managed Streaming for Apache Kafka Developer Guide now includes information about throughput limits for ingress and egress for Express brokers. For more information, see Amazon MSK Express broker quota. |
2025-03-06 |
| Support for Apache Kafka version 3.8.x | Amazon MSK now supports Apache Kafka version 3.8.x. For more information, see Supported Apache Kafka versions. | 2025-02-20 |
| Amazon MSK version 3.4.0 end of support date revised | Revised end of support date for Apache Kafka version 3.4.0 is August 4, 2025. For more information, see Supported Apache Kafka versions. | 2025-02-18 |
| UpdateConnector API launch to modify existing MSK Connect connector configurations |
Amazon MSK now includes the UpdateConnector API to modify existing MSK Connect connector configurations eliminating the need to create new connectors. Also, added documentation of DescribeConnectorOperation and ListConnectorOperations APIs to track connector update operations and maintain historical audit trails of configuration changes. |
2025-01-12 |
| AWS PrivateLink interface VPC endpoints documentation |
Amazon Managed Streaming for Apache Kafka Developer Guide now includes AWS PrivateLink interface VPC endpoints documentation. For more information, see Use Amazon MSK APIs with interface VPC endpoints. |
2024-12-18 |
| MSK Connect 3.7.x version launch | MSK Connect now supports version 3.7.x. For more information, see Understand MSK Connect. | 2024-12-18 |
| Express broker feature added. Developer Guide topics reorganized. | MSK supports Standard and new Express brokers. | 2024-11-6 |
| Graviton upgrade in place feature added. |
You can update your cluster broker size from M5 or T3 to M7g, or from M7g to M5. |
2024-6-25 |
| 3.4.0 end of support date announced. | End of support date for Apache Kafka version 3.4.0 is June 17, 2025. | 2024-6-24 |
| Broker removal feature added. |
You can reduce your provisioned cluster’s storage and compute capacity by removing sets of brokers, with no availability impact, data durability risk, or disruption to your data streaming applications. |
2024-5-16 |
WriteDataIdempotently added to AWSMSKReplicatorExecutionRole |
WriteDataIdempotently permission is added to AWSMSKReplicatorExecutionRole policy to support data replication between MSK clusters. |
2024-5-16 |
| Graviton M7g brokers released in Brazil and Bahrain. |
Amazon MSK now supports South America (sa-east-1, São Paulo) and Middle East (me-south-1, Bahrain) region availability of M7g brokers using AWS Graviton processors (custom Arm-based processors built by Amazon Web Services). |
2024-2-07 |
| Release Graviton M7g brokers to China region | Amazon MSK now supports China region availability of M7g brokers using AWS Graviton processors (custom Arm-based processors built by Amazon Web Services). | 2024-01-11 |
| Amazon MSK Kafka version support policy |
Added explanation of the Amazon MSK supported Kafka version support policy. For more information, see Apache Kafka versions. |
2023-12-08 |
| New service execution role policy to support Amazon MSK Replicator. |
Amazon MSK added new |
2023-12-06 |
| M7g Graviton support |
Amazon MSK now supports M7g brokers using AWS Graviton processors (custom Arm-based processors built by Amazon Web Services). |
2023-11-27 |
| Amazon MSK Replicator |
Amazon MSK Replicator is a new feature that you can use to replicate data between Amazon MSK clusters. Amazon MSK Replicator includes an update to the AmazonMSKFullAccess policy. For more information, see AWS managed policy: |
2023-09-28 |
| Updated for IAM best practices. |
Updated guide to align with the IAM best practices. For more information, see Security best practices in IAM. |
2023-03-08 |
| Service-linked role updates to support multi-VPC private connectivity |
Amazon MSK now includes AWSServiceRoleForKafka service-linked role updates to manage network interfaces and VPC endpoints in your account that make cluster brokers accessible to clients in your VPC. Amazon MSK uses permissions to |
2023-03-08 |
| Support for Apache Kafka 2.7.2 |
Amazon MSK now supports Apache Kafka version 2.7.2. For more information, see Supported Apache Kafka versions. |
2021-12-21 |
| Support for Apache Kafka 2.6.3 |
Amazon MSK now supports Apache Kafka version 2.6.3. For more information, see Supported Apache Kafka versions. |
2021-12-21 |
| MSK Serverless Prerelease |
MSK Serverless is a new feature that you can use to create serverless clusters. For more information, see What is MSK Serverless?. |
2021-11-29 |
| Support for Apache Kafka 2.8.1 |
Amazon MSK now supports Apache Kafka version 2.8.1. For more information, see Supported Apache Kafka versions. |
2021-09-30 |
| MSK Connect |
MSK Connect is a new feature that you can use to create and manage Apache Kafka connectors. For more information, see Understand MSK Connect. |
2021-09-16 |
| Support for Apache Kafka 2.7.1 |
Amazon MSK now supports Apache Kafka version 2.7.1. For more information, see Supported Apache Kafka versions. |
2021-05-25 |
| Support for Apache Kafka 2.8.0 |
Amazon MSK now supports Apache Kafka version 2.8.0. For more information, see Supported Apache Kafka versions. |
2021-04-28 |
| Support for Apache Kafka 2.6.2 |
Amazon MSK now supports Apache Kafka version 2.6.2. For more information, see Supported Apache Kafka versions. |
2021-04-28 |
| Support for Updating Broker Type |
You can now change the broker type for an existing cluster. For more information, see Update the Amazon MSK cluster broker size. |
2021-01-21 |
| Support for Apache Kafka 2.6.1 |
Amazon MSK now supports Apache Kafka version 2.6.1. For more information, see Supported Apache Kafka versions. |
2021-01-19 |
| Support for Apache Kafka 2.7.0 |
Amazon MSK now supports Apache Kafka version 2.7.0. For more information, see Supported Apache Kafka versions. |
2020-12-29 |
| No New Clusters with Apache Kafka Version 1.1.1 | You can no longer create a new Amazon MSK cluster with Apache Kafka version 1.1.1. However, if you have existing MSK clusters that are running Apache Kafka version 1.1.1, you can continue using all of the currently-supported features on those existing clusters. For more information, see Apache Kafka versions. | 2020-11-24 |
| Consumer-Lag Metrics |
Amazon MSK now provides metrics that you can use to monitor consumer lag. For more information, see Monitor an Amazon MSK Provisioned cluster. |
2020-11-23 |
| Support for Cruise Control |
Amazon MSK now supports LinkedIn's Cruise Control. For more information, see Use LinkedIn's Cruise Control for Apache Kafka with Amazon MSK. |
2020-11-17 |
| Support for Apache Kafka 2.6.0 |
Amazon MSK now supports Apache Kafka version 2.6.0. For more information, see Supported Apache Kafka versions. |
2020-10-21 |
| Support for Apache Kafka 2.5.1 |
Amazon MSK now supports Apache Kafka version 2.5.1. With Apache Kafka version 2.5.1, Amazon MSK supports encryption in transit between clients and ZooKeeper endpoints. For more information, see Supported Apache Kafka versions. |
2020-09-30 |
| Application Auto-Expansion |
You can configure Amazon Managed Streaming for Apache Kafka to automatically expand your cluster's storage in response to increased usage. For more information, see Automatic scaling for clusters. |
2020-09-30 |
| Support for Username and Password Security |
Amazon MSK now supports logging into clusters using a username and password. Amazon MSK stores credentials in AWS Secrets Manager. For more information, see SASL/SCRAM authentication. |
2020-09-17 |
| Support for Upgrading the Apache Kafka Version of an Amazon MSK Cluster |
You can now upgrade the Apache Kafka version of an existing MSK cluster. |
2020-05-28 |
| Support for T3.small Broker Nodes |
Amazon MSK now supports creating clusters with brokers of Amazon EC2 type T3.small. |
2020-04-08 |
| Support for Apache Kafka 2.4.1 |
Amazon MSK now supports Apache Kafka version 2.4.1. |
2020-04-02 |
| Support for Streaming Broker Logs | Amazon MSK can now stream broker logs to CloudWatch Logs, Amazon S3, and Amazon Data Firehose. Firehose can, in turn, deliver these logs to the destinations that it supports, such as OpenSearch Service. | 2020-02-25 |
| Support for Apache Kafka 2.3.1 |
Amazon MSK now supports Apache Kafka version 2.3.1. |
2019-12-19 |
Open Monitoring |
Amazon MSK now supports open monitoring with Prometheus. |
2019-12-04 |
Support for Apache Kafka 2.2.1 |
Amazon MSK now supports Apache Kafka version 2.2.1. |
2019-07-31 |
General Availability |
New features include tagging support, authentication, TLS encryption, configurations, and the ability to update broker storage. |
2019-05-30 |
Support for Apache Kafka 2.1.0 |
Amazon MSK now supports Apache Kafka version 2.1.0. |
2019-02-05 |
