Amazon Managed Streaming for Apache Kafka

Managed Apache Kafka cluster with brokers spread across Availability Zones.

Provider: aws
Kind: Stream
Category: Messaging
Official docs: https://docs.aws.amazon.com/msk/latest/developerguide/msk-default-configuration.html
Also known as: MSK

Properties · 9 set by this component

property	type	values	required	kind default	this component
acks	enum	none \| leader \| quorum \| all	no	—	inherited
autoCreateTopics · component property	boolean	—	no	false	inherited
brokerType · component property	enum	standard \| express	no	standard	inherited
clientEncryptionInTransit · component property	enum	tls \| tls-plaintext \| plaintext	no	tls	inherited
compaction	boolean	—	no	false	▸ false
delivery	enum	at-most-once \| at-least-once \| exactly-once	no	at-least-once	▸ at-least-once
encryptionAtRest · component property	boolean	—	no	true	inherited
idempotentProducer · advanced	boolean	—	no	false	inherited
managed	boolean	—	no	false	▸ true
minInsyncReplicas	integer	—	no	—	▸ 2
ordering	enum	per-key \| global	no	per-key	▸ per-key
partitions	integer	—	no	—	▸ 1
replicationFactor	integer	—	no	—	▸ 3
retentionHours	integer	—	no	—	inherited
schemaEnforced	boolean	—	no	false	▸ false
storage	enum	ephemeral \| persistent	no	persistent	▸ persistent
tieredStorage · component property	boolean	—	no	false	inherited
transactions · advanced	boolean	—	no	false	inherited
uncleanLeaderElection · component property	boolean	—	no	true	inherited

Rules that apply · 0

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

No rule reads this kind yet. That is a gap, not a guarantee.

Use it in a design

nodes:
  - { id: "msk", component: "aws-msk" }

Other Stream products · 18

DataHubalibaba-datahubalibabacloudstream ApsaraMQ for Kafkaalibaba-kafkaalibabacloudstream Amazon Kinesis Video Streamsaws-kinesis-video-streamsawsstream Amazon Kinesis Data Streamskinesisawsstream Azure Event Hubsazure-event-hubsazurestream AutoMQautomqstream Confluent Cloudconfluent-cloudstream Apache Kafkakafkastream NATS JetStreamnats-jetstreamstream Apache Pulsarpulsarstream Redpandaredpandastream Apache RocketMQrocketmqstream Generic streamstreamstream WarpStreamwarpstreamstream Managed Service for Apache Kafkagoogle-managed-kafkagcpstream IBM Event Streamsibm-event-streamsibmstream OCI Streamingoci-streamingocistream OCI Streaming with Apache Kafkaoci-streaming-kafkaocistream

Source

1# yaml-language-server: $schema=../../schema/component.schema.json
2# Amazon MSK provisioned cluster: managed Apache Kafka brokers spread over the subnets you give it.
3# "Default Amazon MSK configuration" gives default.replication.factor 3 and min.insync.replicas 2
4# for three-AZ clusters, num.partitions 1, auto.create.topics.enable false and unclean leader
5# election true; "Amazon MSK encryption" says data at rest is always encrypted and TLS is the
6# default for both inter-broker and client traffic.
7schemaVersion: "1"
8type: "component"
9id: "aws-msk"
10kind: "stream"
11provider: "aws"
12docs: "https://docs.aws.amazon.com/msk/latest/developerguide/msk-default-configuration.html"
13aliases: ["MSK"]
14defaults:
15  managed: true
16  delivery: "at-least-once"
17  ordering: "per-key"
18  partitions: 1
19  replicationFactor: 3
20  minInsyncReplicas: 2
21  storage: "persistent"
22  compaction: false
23  schemaEnforced: false
24properties:
25  brokerType:
26    type: "enum"
27    values: ["standard", "express"]
28    default: "standard"
29  clientEncryptionInTransit:
30    type: "enum"
31    values: ["tls", "tls-plaintext", "plaintext"]
32    default: "tls"
33  encryptionAtRest:
34    type: "boolean"
35    default: true
36  tieredStorage:
37    type: "boolean"
38    default: false
39  uncleanLeaderElection:
40    type: "boolean"
41    default: true
42  autoCreateTopics:
43    type: "boolean"
44    default: false

The same page as markdown, for an agent: /catalogue/components/aws-msk.md