Amazon MSK Quota - Amazon Managed Streaming for Apache Kafka

Amazon MSK Quota

Amazon MSK quota

  • Up to 90 brokers per account and 30 brokers per cluster. To request higher quota, create a support case.

  • A minimum of 1 GiB of storage per broker.

  • A maximum of 16384 GiB of storage per broker.

  • A cluster that uses IAM access control can have up to 3000 TCP connections per broker at any given time.

  • A cluster that uses IAM access control can accept new connections at a rate of up to 20 TCP connections per broker per second for all broker types, except for kafka.t3.small. Brokers of type kafka.t3.small are limited to 1 TCP connection per broker per second. If you want a client to retry connections after 1 second, set the configuration parameter reconnect.backoff.ms to 1000. You can also set this parameter to higher values. For more information, see reconnect.backoff.ms in the Apache Kafka documentation.

  • Up to 100 configurations per account. To request higher quota, create a support case.

  • To update the configuration or the Apache Kafka version of an MSK cluster, first ensure the number of partitions per broker is under the limits described in Number of partitions per broker.

MSK Serverless quota

Dimension Quota

Maximum ingress throughput

200 Mbps

Maximum egress throughput 400 Mbps

Max number of client connections

1000

Maximum message size

8 MB

Maximum request size

100 MB

Maximum fetch bytes per request

55 MB

Maximum number of consumer groups

500

Maximum number of partitions

120

Maximum ingress throughput per partition

5 Mbps

Maximum egress throughput per partition

10 Mbps

Maximum partition size

250 GB

Maximum number of client VPCs per serverless cluster

5
Maximum number of serverless clusters per account 1

MSK Connect quota

  • Up to 100 custom plugins.

  • Up to 100 worker configurations.

  • Up to 60 connect workers. If a connector is set up to have auto scaled capacity, then the maximum number of workers that the connector is set up to have is the number MSK Connect uses to calculate the quota for the account.

To request higher quota for MSK Connect, create a support case.