Amazon Managed Streaming for Apache Kafka
aws.amazon.com
- Linux
- Web
- API
What Amazon Managed Streaming for Apache Kafka is
Amazon Managed Streaming for Apache Kafka (MSK) manages Kafka infrastructure and operations for developers and platform engineers running streaming applications on AWS. It provisions and configures clusters, replaces failed servers, coordinates patches and upgrades, and handles monitoring and scaling. Provisioned clusters let customers choose broker and storage options; Serverless clusters adjust resources to workload needs. MSK maintains compatibility with the Apache Kafka open-source client protocol, allowing Kafka applications and tools to work without application code changes. Listed integrations include Amazon S3, Amazon Redshift, Amazon Managed Service for Apache Flink, AWS Lambda, AWS Glue Schema Registry, and AWS Database Migration Service. Clusters span multiple Availability Zones, with three as the default; the service-level agreement guarantees three 9s of availability. Security options include IAM access control, SASL/SCRAM or mutual TLS for Provisioned clusters, and encryption at rest and in transit. CloudWatch provides more than 50 default metrics at no additional cost, while enhanced broker and topic metrics are billed at standard CloudWatch rates. Separate charges may apply to storage, data processing, and connectivity. MSK is intended for developers and DevOps or platform engineers building streaming data applications on AWS.
Who it suits
MSK suits developers and DevOps or platform engineers building streaming applications on AWS. Teams can choose between Provisioned and Serverless clusters depending on how much resource selection they want to manage.
Good to know, and what to watch
- Provisioned and Serverless cluster options
- Kafka client protocol compatibility
- Clusters span multiple Availability Zones
- Supports IAM controls and encryption at rest and in transit
- No free plan
- Enhanced CloudWatch metrics incur standard CloudWatch charges
- Storage, processing, and connectivity can be charged separately
Plans
Every plan and priceMSK Connect
MSK Provisioned — Standard brokers
MSK Replicator
MSK Provisioned — Express brokers
The verdict
MSK handles cluster operations while preserving compatibility with Apache Kafka clients and offering multiple cluster types. Budget for usage-based charges beyond the service's default CloudWatch metrics.
What the maker publishes
- Broker logs
- MSK broker logs can be delivered to CloudWatch Logs, Amazon S3, or Amazon Data Firehose, and MSK API calls can be logged with CloudTrail. source
- Cluster options
- MSK offers Provisioned clusters, where customers choose broker and storage options, and Serverless clusters, which automatically adjust resources to workload needs. source
- Compliance
- AWS states that it supports 143 security standards and compliance certifications, including PCI-DSS, HIPAA/HITECH, FedRAMP, GDPR, FIPS 140-3, and NIST 800-171. source
- Integrations
- Listed integrations include Amazon S3, Amazon Redshift, Amazon Managed Service for Apache Flink, AWS Lambda, AWS Glue Schema Registry, and AWS Database Migration Service. source
- Intended users
- AWS describes MSK as intended for developers and DevOps or platform engineers building streaming data applications on AWS. source
- Kafka compatibility
- MSK maintains compatibility with the Apache Kafka open source client protocol, allowing Kafka applications and tools to work without application code changes. source
- Managed operations
- MSK provisions and configures clusters, replaces failed servers, orchestrates patches and upgrades, and handles monitoring and scaling. source
- Monitoring
- CloudWatch provides a default set of over 50 metrics at no additional cost; enhanced broker and topic metrics are billed at standard CloudWatch rates. source
- Notable cost limit
- Enhanced CloudWatch metrics are billed at standard CloudWatch rates, and MSK pricing also lists separate charges for storage, data processing, and some connectivity. source
- Open monitoring
- For Provisioned clusters, MSK can export JMX and node metrics for monitoring with Prometheus-compatible solutions including Datadog, Lenses, New Relic, and Sumo Logic. source
- Purpose
- Amazon MSK manages Apache Kafka infrastructure and operations so developers and platform engineers can run Kafka on AWS without becoming experts in operating it. source
- Resilience
- Clusters are distributed across multiple Availability Zones, with three as the default, and the MSK service level agreement guarantees three 9s of availability. source
- Security
- MSK supports IAM access control, SASL/SCRAM or mutual TLS authentication for Provisioned clusters, and encryption at rest and in transit. source
Checked against the maker's pages on 3 Oct 2026.